-- Logs begin at Mon 2022-05-23 11:58:16 UTC, end at Mon 2022-05-23 13:04:40 UTC. -- May 23 12:38:16.538396 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... May 23 12:38:16.547277 dv-cinder-master-3-smb devstack@n-api.service[120108]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 12:38:16 2022] *** May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: nodename: dv-cinder-master-3-smb May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: machine: x86_64 May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: clock source: unix May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: pcre jit disabled May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: detected number of CPU cores: 4 May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: current working directory: / May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: detected binary path: /usr/bin/uwsgi-core May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: your processes number limit is 47680 May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: your memory page size is 4096 bytes May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: detected max file descriptor number: 2048 May 23 12:38:16.549322 dv-cinder-master-3-smb devstack@n-api.service[120108]: lock engine: pthread robust mutexes May 23 12:38:16.550128 dv-cinder-master-3-smb devstack@n-api.service[120108]: thunder lock: enabled May 23 12:38:16.550128 dv-cinder-master-3-smb devstack@n-api.service[120108]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 12:38:16.550128 dv-cinder-master-3-smb devstack@n-api.service[120108]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 12:38:16.594441 dv-cinder-master-3-smb devstack@n-api.service[120108]: Python main interpreter initialized at 0x555a9f9e09c0 May 23 12:38:16.594441 dv-cinder-master-3-smb devstack@n-api.service[120108]: python threads support enabled May 23 12:38:16.594441 dv-cinder-master-3-smb devstack@n-api.service[120108]: your server socket listen backlog is limited to 100 connections May 23 12:38:16.594441 dv-cinder-master-3-smb devstack@n-api.service[120108]: your mercy for graceful operations on workers is 90 seconds May 23 12:38:16.594758 dv-cinder-master-3-smb devstack@n-api.service[120108]: mapped 403077 bytes (393 KB) for 2 cores May 23 12:38:16.594832 dv-cinder-master-3-smb devstack@n-api.service[120108]: *** Operational MODE: preforking *** May 23 12:38:16.595058 dv-cinder-master-3-smb devstack@n-api.service[120108]: *** uWSGI is running in multiple interpreter mode *** May 23 12:38:16.595058 dv-cinder-master-3-smb devstack@n-api.service[120108]: spawned uWSGI master process (pid: 120108) May 23 12:38:16.595249 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. May 23 12:38:16.597527 dv-cinder-master-3-smb devstack@n-api.service[120108]: spawned uWSGI worker 1 (pid: 120109, cores: 1) May 23 12:38:16.597527 dv-cinder-master-3-smb devstack@n-api.service[120108]: spawned uWSGI worker 2 (pid: 120110, cores: 1) May 23 12:38:16.597527 dv-cinder-master-3-smb devstack@n-api.service[120108]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 12:38:17.764222 dv-cinder-master-3-smb devstack@n-api.service[120109]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 12:38:17.780981 dv-cinder-master-3-smb devstack@n-api.service[120110]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 12:38:18.490521 dv-cinder-master-3-smb devstack@n-api.service[120109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:38:18.490521 dv-cinder-master-3-smb devstack@n-api.service[120109]: from cryptography.utils import int_from_bytes May 23 12:38:18.490843 dv-cinder-master-3-smb devstack@n-api.service[120109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:38:18.490843 dv-cinder-master-3-smb devstack@n-api.service[120109]: from cryptography.utils import int_from_bytes May 23 12:38:18.495691 dv-cinder-master-3-smb devstack@n-api.service[120110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:38:18.495691 dv-cinder-master-3-smb devstack@n-api.service[120110]: from cryptography.utils import int_from_bytes May 23 12:38:18.496030 dv-cinder-master-3-smb devstack@n-api.service[120110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:38:18.496030 dv-cinder-master-3-smb devstack@n-api.service[120110]: from cryptography.utils import int_from_bytes May 23 12:38:21.133872 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:38:21.134549 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:38:21.134663 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:38:21.135030 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:38:21.135288 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:38:21.135676 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.136005 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.136330 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.136650 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.136983 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.137329 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.137656 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.137980 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.138319 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.138681 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.139006 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.139335 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.139662 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.139973 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.140287 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.140609 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.140919 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.141285 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.141596 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.142091 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.142525 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.142836 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.143150 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.143504 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.143808 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.144124 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.144455 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.144768 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.145093 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.145442 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.145842 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.146164 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.146478 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.146792 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.147233 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.147647 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.147964 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.148290 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.148617 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.148928 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.149288 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.149614 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.149935 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.150257 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.150564 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.150877 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.151189 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.151513 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.151819 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.152131 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.152383 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.152692 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.153017 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.153365 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.153691 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.153946 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.154198 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.154523 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.154845 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.155157 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.155469 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.155776 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.156086 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.156395 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.156704 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.157012 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.157350 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.157670 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.157988 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.158310 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.158618 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.158941 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.159339 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.159592 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.159904 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.160243 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.160563 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.160874 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.161215 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.161538 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.161851 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.162161 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.162470 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.162792 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.163141 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.163528 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.163786 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.164094 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.164409 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.164732 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.165042 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.165378 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.165712 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.165993 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.166303 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.166614 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.166921 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.167232 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.167542 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.167849 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.168159 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.168466 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.168775 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.169097 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.169444 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.169756 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.170091 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.170370 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.170774 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.171102 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.171410 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.171721 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.172044 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.172353 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.172694 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.172982 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.173335 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.173648 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.173946 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.174250 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.174565 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.174880 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.175188 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.175495 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.175801 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.176106 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.176411 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.176716 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.177021 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.177352 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.177658 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.177975 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.178296 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.179281 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.179605 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.179918 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.180898 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.181274 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.182240 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.182596 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.182758 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:38:21.183236 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:38:21.183376 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.183376 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.183655 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:38:21.183796 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.183945 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:38:21.184084 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.184267 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:38:21.184405 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.184552 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.184693 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.184831 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.184968 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.185105 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.185313 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.185456 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.185595 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.185754 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.185906 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.186058 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.186204 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.186343 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.186481 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.186630 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.186770 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.186918 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.187057 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.187201 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.187341 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.187478 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.187650 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.187882 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.188027 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.188166 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.188310 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.188496 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.188637 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.188855 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.188996 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.189301 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.189452 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.189599 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.189849 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.190073 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.190224 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.190422 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.190579 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.190808 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.191063 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.191209 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.191425 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.191700 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.192037 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.192234 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.192417 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.192563 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.192768 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.192915 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.193094 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.193328 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.193547 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.193693 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.193921 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.194219 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.194466 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.194721 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.194914 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.195058 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.195289 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.195448 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.195588 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.195806 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.195959 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.196194 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.196353 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.196493 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.196806 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.196998 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.197218 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.197439 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.197651 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.197863 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.198078 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.198227 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.198952 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.199162 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.199361 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.199506 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.199733 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.199886 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.200090 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.200230 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.200395 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.200671 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.200914 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.201077 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.201278 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.201427 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.201604 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.201752 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.201927 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.202154 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.202307 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.202458 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.202609 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.202747 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.202885 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.203023 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.203161 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.203307 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.203446 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.203586 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.203732 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.203871 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.204045 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.204199 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.204345 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.204494 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.204641 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.204781 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.204948 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.205103 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.205294 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.205442 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.205581 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.205727 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.205875 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.206022 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.206160 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.206304 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.206454 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.206592 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.206763 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.206911 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.207086 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.207235 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.207373 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.207512 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.207659 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.207810 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.207948 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.208121 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.208338 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.208497 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.208639 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.208778 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.208916 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.209060 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.209244 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.209398 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.209537 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.209675 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.209814 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.209950 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.210224 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.210385 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.210526 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.210664 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.210802 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.210942 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.211088 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.211228 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.211366 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.211503 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.211641 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.211779 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.211926 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.212099 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.212347 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.212494 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.212647 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.212793 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.212934 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.213086 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.213264 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.213406 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.213544 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.213684 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.213907 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.214114 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.214307 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.214492 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.214634 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.214848 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.214998 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.215139 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.215385 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.215543 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.215683 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.215892 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.216046 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.216289 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.216479 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.216672 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.216903 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.217059 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.217331 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.217525 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.217728 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.217932 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.218149 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.218393 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.218607 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.218750 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.218890 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.219175 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.219326 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.219510 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.219709 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.219895 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.220037 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.220182 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.220398 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.220616 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.220774 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.220923 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.221254 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.221404 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.221654 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.221810 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.221951 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.222170 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.222374 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.222890 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.223086 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.223280 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.223466 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.223611 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.223840 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.223986 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.224133 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.224342 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.224529 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.224731 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.224912 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.225086 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.225283 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.225467 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.225627 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.225828 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.226020 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.226194 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.226345 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.226485 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.226635 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.226774 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.227004 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.227168 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.227324 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.227464 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.227602 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.227741 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.227887 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.228034 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.228181 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.228320 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.228484 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.228647 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.228859 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.229004 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.229211 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.229370 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.229518 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.229658 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.229797 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.229944 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.230091 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.230231 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.230370 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.230519 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.230659 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.230809 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.230949 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.231087 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.231226 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.231371 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.231510 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.231657 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.231797 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.231936 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.232074 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.232220 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.232369 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.232533 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.232681 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.232839 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.233050 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.233227 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.233385 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.233525 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.233670 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.233809 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.233949 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.234093 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.234241 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.234391 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.234538 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.234677 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.234815 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.234955 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.235124 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.235273 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.235411 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.235550 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.235688 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.235833 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.235986 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.236127 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.236276 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.236416 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.236579 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.236736 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.236876 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.237033 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:38:21.237234 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.237381 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.237521 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.237668 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.237808 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.237947 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.238103 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.238244 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.238416 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.238572 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.238713 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.238870 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.239080 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.239233 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.239373 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.239520 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.239735 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.239882 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.240056 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.240213 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.240367 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.240506 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.240651 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.240791 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.241503 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.241699 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.241920 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.242067 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.242206 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.242345 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.242484 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.242669 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.242826 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.242966 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.243191 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.243337 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.243477 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.243628 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.243778 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.243918 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.244055 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.244359 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.244544 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.244769 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.244983 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.245132 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.245418 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.245568 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.245760 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.246212 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.246412 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.246412 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.246685 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.246906 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.247055 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.247262 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.247432 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.247635 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.247861 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.248009 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.248216 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.248367 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.248561 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.248791 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.249026 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.249344 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.249528 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.249670 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.249913 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.250069 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.250270 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.250451 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.250595 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.250802 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.250998 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.251139 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.251346 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.251521 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.251723 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.251913 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.252056 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.252285 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.252441 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.252606 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.252809 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.253000 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.253328 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.253482 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.253661 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.253822 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.253972 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.254121 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.254261 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.254399 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.254546 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.254697 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.254881 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.255163 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.255397 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.255553 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.255789 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.255937 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.256155 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.256296 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.256624 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.257296 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.257444 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.257593 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.257756 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.257898 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.258036 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.258176 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.258321 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.258459 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.258606 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.258754 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.258894 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.259033 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.259172 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.259335 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.259556 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.259709 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.259849 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.259986 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.260125 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.260276 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.260422 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.260566 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.260719 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.260864 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.261016 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.261235 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.261390 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.261591 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.261743 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.261928 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.262078 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.262233 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.262379 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.262522 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.262667 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.262820 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.262974 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.263120 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.263265 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.263464 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.263628 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.263773 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.263931 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.264079 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.264223 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.264368 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.264513 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.264658 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.264817 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.264963 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.265107 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.265290 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.265437 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.265437 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.265784 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.265931 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.266138 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.266325 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.266325 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.266811 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.267021 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.267021 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.267396 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.267583 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.267583 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.267873 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.268101 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.268101 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.268473 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.268665 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.268812 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.269023 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.269023 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.269376 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.269540 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.269835 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.270039 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.270239 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.270239 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.270599 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.270784 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.270784 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.271175 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.271380 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.271380 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.271717 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.271873 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.271997 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.272113 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.272232 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.272515 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.272631 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.272863 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.273061 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.273263 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.273503 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.273654 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.273800 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.274131 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.274289 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.274445 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.274657 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.274816 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.275047 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.275207 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.275498 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.275653 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.275805 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.276023 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.276239 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.276404 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.276565 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.276710 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.276946 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.277100 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.277296 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.277443 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.277613 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.277771 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.277918 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.278064 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.278209 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.278353 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.278519 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.278667 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.278811 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.278956 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.279101 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.279253 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.279419 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.279572 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.279719 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.279950 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.280111 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.280266 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.280426 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.280573 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.280717 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.280862 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.281007 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.281192 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.281346 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.281502 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.281659 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.281813 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.281959 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.282113 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.282261 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.282414 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.282567 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.282713 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.282858 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.283012 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.283158 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.283311 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.283468 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.283613 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.283771 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.283918 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.284074 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.284256 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.284406 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.284551 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.284705 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.284851 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.284996 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.285172 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.285327 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.285497 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.285653 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.285799 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.285944 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.286088 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.286233 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.286378 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.286531 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.286684 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.286836 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.287065 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.287217 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.287377 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.287541 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.287698 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.287910 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.288057 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.288264 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.288264 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.288658 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.288858 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.288858 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.289249 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.289404 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.289625 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.289824 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.289824 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.290203 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.290357 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.290357 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.290799 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.290959 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.290959 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.291331 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.291530 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.291530 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.291858 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.292010 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.292228 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.292411 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.292411 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.292802 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.292954 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.293251 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.293405 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.293651 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.293805 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.293959 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.294167 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.294319 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.294472 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.294723 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.294876 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.295079 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.295322 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.295525 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.295709 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.295926 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.296146 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.296331 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.296481 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.296626 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.296852 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.297121 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.297320 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.297558 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.297716 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.297871 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.298080 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.298270 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.298486 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.298635 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.298823 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.298977 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.299261 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.299416 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.299590 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.299735 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.299903 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.300075 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.300301 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.300461 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.300615 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.300769 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.300915 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.301068 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.301266 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.301426 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.301574 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.301729 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.301881 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.302027 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.302173 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.302327 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.302474 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.302619 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.302763 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.302908 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.303051 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.303207 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.303360 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.304036 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.304203 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.304435 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.304611 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.304767 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.304913 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.305067 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.305254 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.305349 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.305448 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.305602 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.305737 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.305918 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.306063 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.306228 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.306371 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.306538 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.306695 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.306846 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.307011 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.307192 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.307375 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.307509 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.307668 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.307813 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.307958 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.308122 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.308269 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.308415 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.308559 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.308729 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.308894 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.309049 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.309232 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.309384 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.309530 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.309674 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.309838 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.310001 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.310157 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.310326 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.310545 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.310695 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.310839 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.310993 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.311139 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.311284 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.311428 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.311574 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.311727 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.311873 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.312018 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.312181 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.312328 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.312472 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.312625 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.312820 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.312972 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.313117 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.313368 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.313532 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.313747 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.313895 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.314109 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.314309 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.314457 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.314662 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.314911 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.315068 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.315295 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.315509 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.315813 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.316037 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.316226 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.316441 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.316597 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.316744 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.317012 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.317289 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.317440 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.317677 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.317831 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.318027 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.318177 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.318375 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.318637 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.318796 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.318970 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.319313 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.319484 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.319746 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.319899 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.320100 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.320286 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.320493 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.320751 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.320913 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.321211 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.321374 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.321579 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.321764 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.321963 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.322128 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.322388 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.322388 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.322723 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.322870 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.323015 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.323250 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.323884 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.324078 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.324168 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.324400 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.324508 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.324719 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.324954 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.325043 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.325310 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.325403 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.325628 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.325731 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.325944 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.326031 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.326260 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.326348 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.326576 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.326693 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.326893 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.326984 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.327204 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.327298 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.327514 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.327606 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.327825 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.327918 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.328137 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.328236 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.328443 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.328532 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.328755 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.328843 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.329062 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.329175 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.329433 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.329522 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.329743 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.329831 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.330057 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.330158 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.330378 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.330467 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.330696 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.330783 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.331024 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.331119 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.331331 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.331515 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.332094 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.332165 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.332252 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.332322 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.332387 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.332457 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.332692 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.332969 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.333059 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.333326 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.333552 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.333650 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.333936 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.334118 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.334288 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.334607 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.334760 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.335053 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.335298 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.335619 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.335874 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.336131 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.336467 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.336668 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.337057 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.337246 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.337682 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.337791 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.338352 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.338504 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.338824 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.338939 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.339371 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.339490 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.339920 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.340087 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.340461 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.340819 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.341016 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.341455 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.341583 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.342131 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.342487 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.342677 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.343071 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.343203 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.343706 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.343844 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.344270 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.344409 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.344817 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.344954 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.345389 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.345535 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.345966 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.346143 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.346518 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.346753 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.346946 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.347270 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.347358 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.347853 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.348156 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.348244 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.348480 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.348662 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.348819 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.349022 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.349223 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.349458 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.349611 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.349769 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.349916 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.350077 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.350227 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.350640 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.350796 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.350942 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.351100 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.351256 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.351413 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.351568 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.351715 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.351875 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.352031 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.352178 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.352331 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.352480 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.352625 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.352770 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.352926 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.353073 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.353252 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.353400 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.353559 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.353706 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.353911 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.354066 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.354214 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.354359 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.354506 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.354660 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.354807 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.354975 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.355131 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.355277 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.355422 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.355583 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.355739 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.355938 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.356088 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.356233 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.356379 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.356533 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.356681 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.356826 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.356971 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.357124 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.357312 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.357469 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.357625 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.357773 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.357929 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.358075 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.358233 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.358380 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.358564 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.358757 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.358974 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.359162 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.359375 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.359561 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.359778 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.359982 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.360136 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.360391 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.360554 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.360702 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.360905 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.361097 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.361327 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.361513 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.361844 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.362037 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.362192 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.362430 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.362587 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.362746 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.362966 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.363151 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.363352 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.363541 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.363689 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.363904 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.364055 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.364287 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.364476 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.364688 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.364842 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.365089 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.365332 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.365519 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.365672 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.365870 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.366762 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.366983 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.367137 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.367401 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.367604 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.367809 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.367962 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.368122 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.368347 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.368543 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.368738 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.368933 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.369099 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.369295 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.369574 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.369673 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.369916 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.370113 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.370281 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.370530 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.370621 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.370851 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.370940 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.371168 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.371336 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.371483 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.371571 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.371797 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.371885 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.372111 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.372198 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.372424 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.372520 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.372739 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.372836 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.373043 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.373132 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.373380 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.373483 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.373721 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.373809 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.374043 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.374132 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.374372 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.374548 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.374697 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.374855 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.375016 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.375164 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.375310 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.375455 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.375601 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.375766 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.375914 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.376061 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.376206 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.376353 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.376498 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.376654 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.376813 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.376962 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.377108 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.377279 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.377427 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.377586 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.377841 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.377996 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.378148 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.378295 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.378448 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.378596 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.378749 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.378911 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.379057 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.379203 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.379358 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.379505 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.379650 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.379804 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.379951 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.380096 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.380256 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.380403 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.380548 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.380705 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.380890 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.381043 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.381251 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.381403 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.381737 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.382396 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.382556 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.382714 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.382864 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.383065 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.383216 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.383473 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.383672 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.383931 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.384129 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.384374 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.384374 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.384699 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.384910 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.385110 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.385285 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.385502 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.385656 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.385853 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.386068 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.386219 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.386451 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.386617 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.386823 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.386970 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.387166 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.387384 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.387542 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.387728 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.387934 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.388083 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.388277 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.388530 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.388683 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.388829 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.389054 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.389231 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.389445 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.389631 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.389790 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.390028 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.390180 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.390337 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.390595 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.390810 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.390971 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.391184 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.391397 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.391554 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.391792 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.391994 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.392141 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.392442 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.392605 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.392766 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.393029 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.393280 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.393442 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.393636 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.393784 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.393947 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.394101 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.394261 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.394410 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.394555 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.394709 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.394857 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.395002 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.395148 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.395293 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.395450 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.395605 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.395752 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.395905 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.396079 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.396234 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.396386 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.396548 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.396702 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.396848 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.396994 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.397205 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.397364 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.397537 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.397686 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.397830 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.397989 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.398143 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.398299 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.398446 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.398592 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.398738 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.398915 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.399069 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.399229 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.399387 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.399534 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.399680 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.399827 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.399973 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.400132 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.400287 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.400445 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.400593 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.400740 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.400895 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.401052 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.401228 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.401402 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.401558 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.401707 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.401862 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.402010 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.402155 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.402301 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.402447 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.402635 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.402913 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.403159 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.403313 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.403518 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.403721 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.403941 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.404102 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.404297 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.404537 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.404695 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.404845 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:38:21.405193 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.405754 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.406342 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.406872 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.407441 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.407998 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.408523 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.409120 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.409653 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.410195 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.410738 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.411329 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.411826 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.412367 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.413443 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.413981 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.414287 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.414628 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.414952 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.415269 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.415586 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.415905 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.416257 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.416569 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.416908 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.417253 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.417581 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.417913 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.418229 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.418555 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.418877 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.419195 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.419515 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.419834 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.420153 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.420471 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.420786 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.421099 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.421439 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.421755 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.422074 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.422635 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.422968 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.423287 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.423604 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.423919 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.424236 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.424551 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.424868 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.425203 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.425519 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.425837 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.426163 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.426486 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.426868 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.427223 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.427758 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.428300 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.428915 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.429495 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.430118 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.430668 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.431207 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.431763 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.432327 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.432886 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.433469 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.434038 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.434585 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.435139 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.435695 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.436251 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.436805 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.437388 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.437955 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.438534 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.438879 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.439211 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.439541 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.439872 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.440414 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.440738 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.441082 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.441452 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.441782 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.442109 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.442435 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.442765 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.443078 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.443388 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.443704 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.444019 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.444932 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.445373 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.445603 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.445923 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.446245 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.446559 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.447099 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.447455 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.447777 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.448109 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.448439 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.448760 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.449072 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.449422 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.449734 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.450044 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.450363 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.450677 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.450986 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.451297 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.451670 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.451986 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.452491 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.453035 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.453622 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.454171 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.454732 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.455252 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.455797 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.456348 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.456889 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.457487 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.458001 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.458543 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.459102 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.459644 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.460405 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.460956 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.461537 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.462087 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.462633 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.463240 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.463632 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.463955 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.464277 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.464607 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.464932 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.465177 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO dbcounter [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Registered counter for database nova_api May 23 12:38:21.465276 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.465603 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.465928 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.466282 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.466606 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.467148 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.467486 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.467809 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.468144 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.468478 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.468790 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.469101 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.469435 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.469762 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.470076 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.470388 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.470699 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.471018 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.471373 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.471814 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.472357 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.473186 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.473734 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.474263 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.474852 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.475887 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.476600 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.477274 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.477796 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.478354 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.478913 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.479472 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.480014 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.480568 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.481114 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.481703 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.482245 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.482847 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.483255 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.483580 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.484021 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.484351 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.484687 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.485019 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.485366 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.485697 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.486023 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.486345 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.486632 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG oslo_db.sqlalchemy.engines [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:38:21.486813 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.486977 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.487311 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.487654 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.487987 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.488316 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.488626 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.488935 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.489265 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.489583 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.489906 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.490221 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.490528 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.490836 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.491820 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.492138 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.492454 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.492764 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.493074 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.493414 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.493724 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.493866 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG dbcounter [-] [120110] Writer thread running {{(pid=120110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:38:21.494034 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.494344 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.494653 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.494960 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.495360 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.495726 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.496244 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.496776 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.497347 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.497879 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.498408 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.498985 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.499562 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.500116 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.500687 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.501278 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.501872 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.502410 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.502985 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.503550 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.504113 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.504663 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.505271 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.505880 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.506379 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.506974 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.507534 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.507872 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.508200 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.508540 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.508877 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.509219 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.509558 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.509883 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.510212 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.510536 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.510852 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.511184 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.511502 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.511819 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.512138 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.512451 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.512765 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.513085 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.513432 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.513762 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.514090 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.514403 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.514730 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.515056 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.515402 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.515717 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.516064 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.516397 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.516721 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.517032 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.517368 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:38:21.517612 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:38:21.551125 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.context [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),42607727-9048-45c2-8317-fc63a315fdc3(cell1) {{(pid=120110) load_cells /opt/stack/nova/nova/context.py:464}} May 23 12:38:21.556087 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG oslo_concurrency.lockutils [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:21.557688 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG oslo_concurrency.lockutils [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:21.558497 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG oslo_concurrency.lockutils [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:21.560446 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG oslo_concurrency.lockutils [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:21.562462 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO dbcounter [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Registered counter for database nova_cell0 May 23 12:38:21.566554 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO dbcounter [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Registered counter for database nova_cell1 May 23 12:38:21.574084 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG oslo_db.sqlalchemy.engines [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:38:21.578151 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG oslo_db.sqlalchemy.engines [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:38:21.584149 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG dbcounter [-] [120110] Writer thread running {{(pid=120110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:38:21.586687 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG dbcounter [-] [120110] Writer thread running {{(pid=120110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:38:21.597904 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO dbcounter [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Registered counter for database nova_api May 23 12:38:21.622169 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_db.sqlalchemy.engines [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:38:21.628789 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writer thread running {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:38:21.704697 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.context [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),42607727-9048-45c2-8317-fc63a315fdc3(cell1) {{(pid=120109) load_cells /opt/stack/nova/nova/context.py:464}} May 23 12:38:21.711290 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:21.712894 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:21.713703 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:38:21.715746 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:38:21.717754 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO dbcounter [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Registered counter for database nova_cell0 May 23 12:38:21.721760 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO dbcounter [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Registered counter for database nova_cell1 May 23 12:38:21.731914 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_db.sqlalchemy.engines [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:38:21.735114 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO dbcounter [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Registered counter for database nova_cell0 May 23 12:38:21.735333 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_db.sqlalchemy.engines [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:38:21.738321 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writer thread running {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:38:21.744464 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG oslo_db.sqlalchemy.engines [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:38:21.748953 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG dbcounter [-] [120110] Writer thread running {{(pid=120110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:38:21.884718 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writer thread running {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:38:21.893884 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO dbcounter [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Registered counter for database nova_cell0 May 23 12:38:21.903712 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_db.sqlalchemy.engines [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:38:21.908111 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writer thread running {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:38:22.183609 dv-cinder-master-3-smb devstack@n-api.service[120110]: WARNING keystonemiddleware.auth_token [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:38:22.190832 dv-cinder-master-3-smb devstack@n-api.service[120110]: WARNING keystonemiddleware.auth_token [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:38:22.229759 dv-cinder-master-3-smb devstack@n-api.service[120109]: WARNING keystonemiddleware.auth_token [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:38:22.237991 dv-cinder-master-3-smb devstack@n-api.service[120109]: WARNING keystonemiddleware.auth_token [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:38:22.588611 dv-cinder-master-3-smb devstack@n-api.service[120109]: WARNING keystonemiddleware.auth_token [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:38:22.595016 dv-cinder-master-3-smb devstack@n-api.service[120109]: WARNING keystonemiddleware.auth_token [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:38:22.600616 dv-cinder-master-3-smb devstack@n-api.service[120109]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a9f9e09c0 pid: 120109 (default app) May 23 12:38:22.602793 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:38:22.603972 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001772 May 23 12:38:22.604383 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Mon May 23 12:38:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:38:22.622117 dv-cinder-master-3-smb devstack@n-api.service[120110]: WARNING keystonemiddleware.auth_token [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:38:22.629716 dv-cinder-master-3-smb devstack@n-api.service[120110]: WARNING keystonemiddleware.auth_token [None req-abbe9863-7670-4d69-9e83-44fa17107d84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:38:22.639501 dv-cinder-master-3-smb devstack@n-api.service[120110]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a9f9e09c0 pid: 120110 (default app) May 23 12:39:41.128167 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:41.129174 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 23 12:39:41.129570 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:41.142177 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG dbcounter [-] [120110] Writing DB stats nova_api:SELECT=3 {{(pid=120110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:41.143296 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG dbcounter [-] [120110] Writing DB stats nova_cell0:SELECT=3 {{(pid=120110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:41.144273 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG dbcounter [-] [120110] Writing DB stats nova_cell1:SELECT=3 {{(pid=120110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:41.144999 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG dbcounter [-] [120110] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=120110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:41.602760 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-37a8896f-ffbf-4f3d-a95d-70a93f27d98d admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:41.632803 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-37a8896f-ffbf-4f3d-a95d-70a93f27d98d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.495681 May 23 12:39:41.633884 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Mon May 23 12:39:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:44.001475 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:44.003201 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-5f57a39f-5a89-46e5-9166-ef4b440943d0 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002220 May 23 12:39:44.003902 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:39:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:44.070429 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-d2eb2b31-1f17-47ad-90d4-ddbd1659b431 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "swap": 0, "name": "cirros256"}} {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:44.091204 dv-cinder-master-3-smb devstack@n-api.service[120110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:39:44.091204 dv-cinder-master-3-smb devstack@n-api.service[120110]: warnings.warn(msg) May 23 12:39:44.122590 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-d2eb2b31-1f17-47ad-90d4-ddbd1659b431 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111168 May 23 12:39:44.123171 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Mon May 23 12:39:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 12:39:44.137927 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writing DB stats nova_api:SELECT=3 {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:44.139458 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writing DB stats nova_cell0:SELECT=3 {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:44.140932 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writing DB stats nova_cell1:SELECT=3 {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:44.141693 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writing DB stats nova_cell0:SELECT=3 {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:44.399873 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-aa1cf7ca-d854-4351-91e9-e723bed576dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:44.402383 dv-cinder-master-3-smb devstack@n-api.service[120109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:39:44.402383 dv-cinder-master-3-smb devstack@n-api.service[120109]: warnings.warn(msg) May 23 12:39:44.470749 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-aa1cf7ca-d854-4351-91e9-e723bed576dd admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.339287 May 23 12:39:44.481332 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Mon May 23 12:39:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:46.793067 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-d2eb2b31-1f17-47ad-90d4-ddbd1659b431 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:46.794052 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-d2eb2b31-1f17-47ad-90d4-ddbd1659b431 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 23 12:39:46.794455 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:46.901824 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-f23ae9b0-58fd-4d72-b6bd-68aaa2625865 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:46.922129 dv-cinder-master-3-smb devstack@n-api.service[120109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:39:46.922129 dv-cinder-master-3-smb devstack@n-api.service[120109]: warnings.warn(msg) May 23 12:39:46.941410 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-f23ae9b0-58fd-4d72-b6bd-68aaa2625865 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140821 May 23 12:39:46.941960 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Mon May 23 12:39:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:39:46.954688 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-bad5d2ca-c0b0-4841-be3b-794ce1c758ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:46.956360 dv-cinder-master-3-smb devstack@n-api.service[120110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:39:46.956360 dv-cinder-master-3-smb devstack@n-api.service[120110]: warnings.warn(msg) May 23 12:39:46.994268 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-bad5d2ca-c0b0-4841-be3b-794ce1c758ff admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043212 May 23 12:39:46.994791 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Mon May 23 12:39:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:49.271426 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-f23ae9b0-58fd-4d72-b6bd-68aaa2625865 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:49.272554 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-f23ae9b0-58fd-4d72-b6bd-68aaa2625865 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 May 23 12:39:49.273123 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:39:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:49.343625 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-cd1d019c-3e6f-4fb1-a3c7-bb8e54b49e36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:49.364556 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-cd1d019c-3e6f-4fb1-a3c7-bb8e54b49e36 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085201 May 23 12:39:49.365371 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Mon May 23 12:39:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:39:49.377967 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-7d3c7a7d-2621-4f24-a640-d940fe920cd5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:49.402200 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-7d3c7a7d-2621-4f24-a640-d940fe920cd5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028114 May 23 12:39:49.402879 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Mon May 23 12:39:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:51.718764 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-cd1d019c-3e6f-4fb1-a3c7-bb8e54b49e36 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:51.719780 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-cd1d019c-3e6f-4fb1-a3c7-bb8e54b49e36 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 23 12:39:51.720184 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:39:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:51.784033 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-c0292f9a-9941-40ec-b973-0624f797fe06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "id": "d3", "swap": 0}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:51.804649 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-c0292f9a-9941-40ec-b973-0624f797fe06 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077230 May 23 12:39:51.805221 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Mon May 23 12:39:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:39:51.817305 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a788f308-c6e0-4847-b6dd-45f3ec621874 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:51.842326 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-a788f308-c6e0-4847-b6dd-45f3ec621874 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028904 May 23 12:39:51.842956 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Mon May 23 12:39:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:39:54.141330 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-c0292f9a-9941-40ec-b973-0624f797fe06 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:54.142325 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-c0292f9a-9941-40ec-b973-0624f797fe06 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 23 12:39:54.142889 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:54.203862 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-e57ec4df-8a2d-48ad-88aa-76fb15addbeb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:54.222324 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-e57ec4df-8a2d-48ad-88aa-76fb15addbeb admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073285 May 23 12:39:54.223192 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Mon May 23 12:39:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:39:54.235952 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-4d0c7081-0ab1-4407-852c-2e2901234b3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:54.259852 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-4d0c7081-0ab1-4407-852c-2e2901234b3f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027952 May 23 12:39:54.260580 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Mon May 23 12:39:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:39:56.517845 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-e57ec4df-8a2d-48ad-88aa-76fb15addbeb admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:56.518915 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-e57ec4df-8a2d-48ad-88aa-76fb15addbeb admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 May 23 12:39:56.519713 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:56.585308 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-090ae023-2025-4783-b662-a598d255d168 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:56.610048 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-090ae023-2025-4783-b662-a598d255d168 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082804 May 23 12:39:56.610703 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Mon May 23 12:39:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:39:58.920443 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-e57ec4df-8a2d-48ad-88aa-76fb15addbeb admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:39:58.921446 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-e57ec4df-8a2d-48ad-88aa-76fb15addbeb admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 23 12:39:58.921852 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:39:58.982548 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-4cdca107-b042-4537-b3f3-05e34c0b5e8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "vcpus": 1}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:59.001455 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-4cdca107-b042-4537-b3f3-05e34c0b5e8b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073542 May 23 12:39:59.002033 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Mon May 23 12:39:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:39:59.014118 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-33392db7-e8df-4127-ac2a-fd45d9d21be4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:39:59.039231 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-33392db7-e8df-4127-ac2a-fd45d9d21be4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028450 May 23 12:39:59.039869 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Mon May 23 12:39:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:02.260990 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-4cdca107-b042-4537-b3f3-05e34c0b5e8b admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:02.262053 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-4cdca107-b042-4537-b3f3-05e34c0b5e8b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 23 12:40:02.262458 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:40:02.323003 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-ae874aae-e26a-4be0-8c0a-75587b44a5fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "ram": 2048}} {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:02.343455 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-ae874aae-e26a-4be0-8c0a-75587b44a5fd admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074976 May 23 12:40:02.344015 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Mon May 23 12:40:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:40:02.356645 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-bd683ee5-84c1-4380-acc4-a0aa28290fda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:02.387268 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-bd683ee5-84c1-4380-acc4-a0aa28290fda admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034423 May 23 12:40:02.387840 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Mon May 23 12:40:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:04.791335 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-ae874aae-e26a-4be0-8c0a-75587b44a5fd admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:04.792353 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-ae874aae-e26a-4be0-8c0a-75587b44a5fd admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 23 12:40:04.792758 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:04.851502 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-290c7b6d-94f8-4bf7-ae76-027400029a3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "disk": 40, "name": "m1.medium"}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:04.868602 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-290c7b6d-94f8-4bf7-ae76-027400029a3e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070030 May 23 12:40:04.869167 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Mon May 23 12:40:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 12:40:04.880902 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-bc9fc1af-10a0-4e92-94ea-7d00f27904cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:04.904331 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-bc9fc1af-10a0-4e92-94ea-7d00f27904cd admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027086 May 23 12:40:04.905087 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Mon May 23 12:40:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:40:07.169299 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-290c7b6d-94f8-4bf7-ae76-027400029a3e admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:07.170424 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-290c7b6d-94f8-4bf7-ae76-027400029a3e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 May 23 12:40:07.170970 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:07.237506 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-00b47c54-c57f-4e8d-8b08-08b183c043b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "swap": 0, "id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:07.256044 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-00b47c54-c57f-4e8d-8b08-08b183c043b9 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079074 May 23 12:40:07.256713 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Mon May 23 12:40:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:40:07.268582 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-fc6b4c67-277d-4633-ac92-a44353565e37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:07.292388 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-fc6b4c67-277d-4633-ac92-a44353565e37 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027495 May 23 12:40:07.293075 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Mon May 23 12:40:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:40:09.656400 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-00b47c54-c57f-4e8d-8b08-08b183c043b9 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:09.657701 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-00b47c54-c57f-4e8d-8b08-08b183c043b9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001780 May 23 12:40:09.658211 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:40:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:09.722792 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-446f6e0f-3f81-4250-b6e9-1f467336ca81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:09.742119 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-446f6e0f-3f81-4250-b6e9-1f467336ca81 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077018 May 23 12:40:09.743433 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Mon May 23 12:40:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:40:09.754963 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-58b74d59-24f6-41e5-b4aa-cd8d8f19eed0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:09.779410 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-58b74d59-24f6-41e5-b4aa-cd8d8f19eed0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027829 May 23 12:40:09.780165 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Mon May 23 12:40:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:40:34.114922 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-446f6e0f-3f81-4250-b6e9-1f467336ca81 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:34.116427 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-446f6e0f-3f81-4250-b6e9-1f467336ca81 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001948 May 23 12:40:34.116820 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:40:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:34.127285 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG dbcounter [-] [120110] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=120110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:34.176108 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-7a367b74-542b-4397-85ca-de434af8a860 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:34.194542 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-7a367b74-542b-4397-85ca-de434af8a860 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071794 May 23 12:40:34.195070 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Mon May 23 12:40:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:35.207848 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-446f6e0f-3f81-4250-b6e9-1f467336ca81 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:35.208944 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-446f6e0f-3f81-4250-b6e9-1f467336ca81 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 23 12:40:35.209987 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:35.410721 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-660b20e2-5f79-47cd-83f7-87fb6caf672e admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:35.416478 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.wsgi [None req-660b20e2-5f79-47cd-83f7-87fb6caf672e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-660b20e2-5f79-47cd-83f7-87fb6caf672e admin admin] Request method failure captured: May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: Accept: application/json May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: Accept-Encoding: gzip, deflate May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: Connection: keep-alive May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: Content-Length: 0 May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: Host: 10.222.0.45 May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: Openstack-Api-Version: compute 2.90 May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: Openstack-System-Scope: None May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: User-Agent: python-novaclient May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Auth-Token: gAAAAABii4DDoVzI42E3xxuSvA4TzjGi0pibzNimdXj_g6ZnUl010ELWsE8CVcHpS6IOUxlxnIZLRQIh_6eU43T1nilj21VwXdyEZI8LK_W_WfZcvlvhg6I-Xot0gwjyjx9taO6D1lOwPu9lbP8VnjOChuxcQpuYVM95WaLik1HSVU6cJXf4nUM May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Domain-Id: None May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Domain-Name: None May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Identity-Status: Confirmed May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Is-Admin-Project: True May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Domain-Id: default May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Domain-Name: Default May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Name: admin May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Role: admin,reader,member May 23 12:40:35.419806 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Roles: admin,reader,member May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Tenant: admin May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Tenant-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Tenant-Name: admin May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User: admin May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Domain-Id: default May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Domain-Name: Default May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Id: a725360ad03a444db8a80dca5cc7c54a May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Name: admin May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: method: > May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: exception: Flavor 42 could not be found. May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: action_args: {'id': '42'} May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:40:35.421505 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:35.422619 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:35.424007 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-660b20e2-5f79-47cd-83f7-87fb6caf672e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:40:35.425282 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-660b20e2-5f79-47cd-83f7-87fb6caf672e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063103 May 23 12:40:35.425282 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Mon May 23 12:40:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 12:40:35.431565 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-7311adc5-e30c-4547-be24-111689891f1a admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:35.434568 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:35.454502 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-7311adc5-e30c-4547-be24-111689891f1a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027143 May 23 12:40:35.455043 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Mon May 23 12:40:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:40:35.464590 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-6ea51ff8-8644-41ae-b4c2-a177c820af1c admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:35.485637 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-6ea51ff8-8644-41ae-b4c2-a177c820af1c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024578 May 23 12:40:35.486161 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Mon May 23 12:40:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:40:35.496837 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-47c445ef-b217-43c0-bf3a-6e4b5425d103 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:35.503110 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.wsgi [None req-47c445ef-b217-43c0-bf3a-6e4b5425d103 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-47c445ef-b217-43c0-bf3a-6e4b5425d103 admin admin] Request method failure captured: May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: Accept: application/json May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: Accept-Encoding: gzip, deflate May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: Connection: keep-alive May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: Content-Length: 0 May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: Host: 10.222.0.45 May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: Openstack-Api-Version: compute 2.90 May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: Openstack-System-Scope: None May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: User-Agent: python-novaclient May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Auth-Token: gAAAAABii4DDoVzI42E3xxuSvA4TzjGi0pibzNimdXj_g6ZnUl010ELWsE8CVcHpS6IOUxlxnIZLRQIh_6eU43T1nilj21VwXdyEZI8LK_W_WfZcvlvhg6I-Xot0gwjyjx9taO6D1lOwPu9lbP8VnjOChuxcQpuYVM95WaLik1HSVU6cJXf4nUM May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Domain-Id: None May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Domain-Name: None May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Identity-Status: Confirmed May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Is-Admin-Project: True May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Domain-Id: default May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Domain-Name: Default May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Name: admin May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Role: admin,reader,member May 23 12:40:35.507030 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Roles: admin,reader,member May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Tenant: admin May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Tenant-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Tenant-Name: admin May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User: admin May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Domain-Id: default May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Domain-Name: Default May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Id: a725360ad03a444db8a80dca5cc7c54a May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Name: admin May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: method: > May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: exception: Flavor 42 could not be found. May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: action_args: {'id': '42'} May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:40:35.508546 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:35.509640 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:35.510909 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-47c445ef-b217-43c0-bf3a-6e4b5425d103 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:40:35.512102 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-47c445ef-b217-43c0-bf3a-6e4b5425d103 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015999 May 23 12:40:35.512102 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Mon May 23 12:40:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 12:40:36.375174 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-6ea51ff8-8644-41ae-b4c2-a177c820af1c admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:36.376178 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-6ea51ff8-8644-41ae-b4c2-a177c820af1c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 23 12:40:36.376581 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:36.564047 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-15e0f82a-4458-48ce-90e4-b06e5efd7092 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:36.570399 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.wsgi [None req-15e0f82a-4458-48ce-90e4-b06e5efd7092 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-15e0f82a-4458-48ce-90e4-b06e5efd7092 admin admin] Request method failure captured: May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: Accept: application/json May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: Accept-Encoding: gzip, deflate May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: Connection: keep-alive May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: Content-Length: 0 May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: Host: 10.222.0.45 May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: Openstack-Api-Version: compute 2.90 May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: Openstack-System-Scope: None May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: User-Agent: python-novaclient May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Auth-Token: gAAAAABii4DEeC63KpaTU-FU7ErQZsgT0y-6n9G3w4-A6G9OcR7l918arANRMbfE6hLJQh3CH9MYzcJgHVETIWad15tK6IdTNco0W3nJan4u6weklJdC17pjye0Ad6eJqnIxmURP6JGZAQDdyMkmmtzVpKkGdqEC1Y6WIV-NG8RvWJ5EoXidU04 May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Domain-Id: None May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Domain-Name: None May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Identity-Status: Confirmed May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Is-Admin-Project: True May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Domain-Id: default May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Domain-Name: Default May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Name: admin May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Role: admin,reader,member May 23 12:40:36.571874 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Roles: admin,reader,member May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Tenant: admin May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Tenant-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Tenant-Name: admin May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User: admin May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Domain-Id: default May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Domain-Name: Default May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Id: a725360ad03a444db8a80dca5cc7c54a May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Name: admin May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: method: > May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: exception: Flavor 84 could not be found. May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: action_args: {'id': '84'} May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:40:36.573240 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:36.574129 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:36.575464 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-15e0f82a-4458-48ce-90e4-b06e5efd7092 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:40:36.576732 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-15e0f82a-4458-48ce-90e4-b06e5efd7092 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060108 May 23 12:40:36.576732 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Mon May 23 12:40:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 12:40:36.583095 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-1e2eeaae-de3e-4a42-b8dd-ce026333ffaa admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:36.598556 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-1e2eeaae-de3e-4a42-b8dd-ce026333ffaa admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019103 May 23 12:40:36.599355 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Mon May 23 12:40:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:36.608778 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-78c8f750-5a96-43a7-b068-babc326fe2b1 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:36.622502 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-78c8f750-5a96-43a7-b068-babc326fe2b1 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017267 May 23 12:40:36.623024 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Mon May 23 12:40:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:36.632536 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a3bd5244-58db-4cc6-a17e-afd022f19e6e admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:36.637930 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.wsgi [None req-a3bd5244-58db-4cc6-a17e-afd022f19e6e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a3bd5244-58db-4cc6-a17e-afd022f19e6e admin admin] Request method failure captured: May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: Accept: application/json May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: Accept-Encoding: gzip, deflate May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: Connection: keep-alive May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: Content-Length: 0 May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: Host: 10.222.0.45 May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: Openstack-Api-Version: compute 2.90 May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: Openstack-System-Scope: None May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: User-Agent: python-novaclient May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Auth-Token: gAAAAABii4DEeC63KpaTU-FU7ErQZsgT0y-6n9G3w4-A6G9OcR7l918arANRMbfE6hLJQh3CH9MYzcJgHVETIWad15tK6IdTNco0W3nJan4u6weklJdC17pjye0Ad6eJqnIxmURP6JGZAQDdyMkmmtzVpKkGdqEC1Y6WIV-NG8RvWJ5EoXidU04 May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Domain-Id: None May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Domain-Name: None May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Identity-Status: Confirmed May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Is-Admin-Project: True May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Domain-Id: default May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Domain-Name: Default May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Name: admin May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Role: admin,reader,member May 23 12:40:36.639419 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Roles: admin,reader,member May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Tenant: admin May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Tenant-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Tenant-Name: admin May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User: admin May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Domain-Id: default May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Domain-Name: Default May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Id: a725360ad03a444db8a80dca5cc7c54a May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Name: admin May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: method: > May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: exception: Flavor 84 could not be found. May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: action_args: {'id': '84'} May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:40:36.640674 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:36.641440 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:36.642467 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a3bd5244-58db-4cc6-a17e-afd022f19e6e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:40:36.643458 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-a3bd5244-58db-4cc6-a17e-afd022f19e6e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012388 May 23 12:40:36.643458 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Mon May 23 12:40:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 12:40:37.512687 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-78c8f750-5a96-43a7-b068-babc326fe2b1 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:37.513730 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-78c8f750-5a96-43a7-b068-babc326fe2b1 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 23 12:40:37.514130 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:40:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:37.704828 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-92ad646a-b480-4c7b-ba56-286146fac711 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:37.710861 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.wsgi [None req-92ad646a-b480-4c7b-ba56-286146fac711 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-92ad646a-b480-4c7b-ba56-286146fac711 admin admin] Request method failure captured: May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: Accept: application/json May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: Accept-Encoding: gzip, deflate May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: Connection: keep-alive May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: Content-Length: 0 May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: Host: 10.222.0.45 May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: Openstack-Api-Version: compute 2.90 May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: Openstack-System-Scope: None May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: User-Agent: python-novaclient May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Auth-Token: gAAAAABii4DFodUxaJ0HLdoNBehwfz7HAYhdv-m95VfQoMIobMsxulgWxwWwRiJAN2j-O8dnt5wKYWBfnktiJIyy3gUz-9VnQ2GgFZu4EQsyy4NktG5uozLi-JJbRu2-NQD-pUZ_aDGYhgJP4kx7tplwpI3QLE0AkCRgY7up_lJgJ0hU68moYoU May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Domain-Id: None May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Domain-Name: None May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Identity-Status: Confirmed May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Is-Admin-Project: True May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Domain-Id: default May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Domain-Name: Default May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Project-Name: admin May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Role: admin,reader,member May 23 12:40:37.712365 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Roles: admin,reader,member May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Tenant: admin May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Tenant-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-Tenant-Name: admin May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User: admin May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Domain-Id: default May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Domain-Name: Default May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Id: a725360ad03a444db8a80dca5cc7c54a May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: X-User-Name: admin May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: method: > May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: exception: Flavor 451 could not be found. May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: action_args: {'id': '451'} May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:40:37.713968 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:37.715964 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: ERROR nova.api.openstack.wsgi May 23 12:40:37.717281 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-92ad646a-b480-4c7b-ba56-286146fac711 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:40:37.718757 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-92ad646a-b480-4c7b-ba56-286146fac711 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061784 May 23 12:40:37.718757 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Mon May 23 12:40:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 12:40:37.723497 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-fdcb711f-9a39-499c-9d30-f6042d48ffda admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:37.738783 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-fdcb711f-9a39-499c-9d30-f6042d48ffda admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018809 May 23 12:40:37.739312 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Mon May 23 12:40:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:37.749332 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:37.763475 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017684 May 23 12:40:37.763998 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Mon May 23 12:40:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:40:37.773234 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-ea64a0da-1f7e-4f7d-a4d0-14d438d38af5 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:37.778553 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.wsgi [None req-ea64a0da-1f7e-4f7d-a4d0-14d438d38af5 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-ea64a0da-1f7e-4f7d-a4d0-14d438d38af5 admin admin] Request method failure captured: May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: Accept: application/json May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: Accept-Encoding: gzip, deflate May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: Connection: keep-alive May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: Content-Length: 0 May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: Host: 10.222.0.45 May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: Openstack-Api-Version: compute 2.90 May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: Openstack-System-Scope: None May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: User-Agent: python-novaclient May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Auth-Token: gAAAAABii4DFodUxaJ0HLdoNBehwfz7HAYhdv-m95VfQoMIobMsxulgWxwWwRiJAN2j-O8dnt5wKYWBfnktiJIyy3gUz-9VnQ2GgFZu4EQsyy4NktG5uozLi-JJbRu2-NQD-pUZ_aDGYhgJP4kx7tplwpI3QLE0AkCRgY7up_lJgJ0hU68moYoU May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Domain-Id: None May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Domain-Name: None May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Identity-Status: Confirmed May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Is-Admin-Project: True May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Openstack-Nova-Api-Version: 2.90 May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Domain-Id: default May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Domain-Name: Default May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Project-Name: admin May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Role: admin,reader,member May 23 12:40:37.780049 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Roles: admin,reader,member May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_42a3411808a2449f8a4f73e9a1925a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Tenant: admin May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Tenant-Id: 42a3411808a2449f8a4f73e9a1925a0f May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-Tenant-Name: admin May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User: admin May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Domain-Id: default May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Domain-Name: Default May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Id: a725360ad03a444db8a80dca5cc7c54a May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: X-User-Name: admin May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: method: > May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: exception: Flavor 451 could not be found. May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: action_args: {'id': '451'} May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:40:37.781672 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:37.782819 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: ERROR nova.api.openstack.wsgi May 23 12:40:37.784453 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-ea64a0da-1f7e-4f7d-a4d0-14d438d38af5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:40:37.785730 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-ea64a0da-1f7e-4f7d-a4d0-14d438d38af5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011904 May 23 12:40:37.785730 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Mon May 23 12:40:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 12:40:38.676095 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:38.677090 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 23 12:40:38.677508 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:40:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:38.869666 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-408cc0f9-6b17-4bfc-9d2f-d447572f44dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:38.886950 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-408cc0f9-6b17-4bfc-9d2f-d447572f44dd admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069025 May 23 12:40:38.887421 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Mon May 23 12:40:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:40:39.757445 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:39.758442 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 23 12:40:39.758840 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:40:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:39.948696 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-5a07326e-b9af-476a-86c3-7e8bbe80c9f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:39.966634 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-5a07326e-b9af-476a-86c3-7e8bbe80c9f1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069818 May 23 12:40:39.967147 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Mon May 23 12:40:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:40:40.841275 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:40.842274 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 23 12:40:40.842672 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:41.032477 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-1ad5dfc8-9922-4b05-99c1-b6dfdab15afd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:41.051131 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-1ad5dfc8-9922-4b05-99c1-b6dfdab15afd admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070338 May 23 12:40:41.051685 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Mon May 23 12:40:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:40:41.930783 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:41.931810 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 23 12:40:41.932216 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:40:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:42.125183 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-9ed69a68-92e7-4e00-a7e0-b8053e004cac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:40:42.142555 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-9ed69a68-92e7-4e00-a7e0-b8053e004cac admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069877 May 23 12:40:42.143030 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Mon May 23 12:40:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:40:43.017026 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:43.018053 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 23 12:40:43.018447 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:40:43.208183 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-95f7591f-bae4-42b2-af5a-c158072b2e07 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:40:43.228677 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-95f7591f-bae4-42b2-af5a-c158072b2e07 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072215 May 23 12:40:43.229205 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Mon May 23 12:40:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:41:45.360062 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:45.361072 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-a6807a3c-6002-40d5-8408-6eff387394f9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 23 12:41:45.361516 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Mon May 23 12:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:41:45.369697 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:45.423827 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-0fc947dc-1bb0-4a1e-9adc-3eaaf5628798 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:45.446923 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-0fc947dc-1bb0-4a1e-9adc-3eaaf5628798 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078657 May 23 12:41:45.447467 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Mon May 23 12:41:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:41:45.468080 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG dbcounter [-] [120110] Writing DB stats nova_api:SELECT=14 {{(pid=120110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:45.471814 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-8d400f09-8c82-4dba-a7a6-904f517cc447 admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:45.480336 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-8d400f09-8c82-4dba-a7a6-904f517cc447 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013689 May 23 12:41:45.480849 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Mon May 23 12:41:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:41:45.492833 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-d77260f2-0109-4965-a8b1-6528660c5737 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:45.500438 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-d77260f2-0109-4965-a8b1-6528660c5737 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011795 May 23 12:41:45.500945 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Mon May 23 12:41:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:41:45.513912 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-e11e2037-81e5-4bad-902a-48c027c7c60d admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:45.520165 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-e11e2037-81e5-4bad-902a-48c027c7c60d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011583 May 23 12:41:45.520940 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Mon May 23 12:41:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:41:45.533661 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-ad371cbb-3143-428b-93b6-bac59db8b424 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:41:45.542068 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-ad371cbb-3143-428b-93b6-bac59db8b424 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011983 May 23 12:41:45.542601 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Mon May 23 12:41:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:45:31.701383 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-e11e2037-81e5-4bad-902a-48c027c7c60d admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:31.702342 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-e11e2037-81e5-4bad-902a-48c027c7c60d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 23 12:45:31.702741 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:45:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:45:31.863492 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writing DB stats nova_api:SELECT=6 {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:31.980366 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-0af602a8-1942-4724-97a0-17fd0316c6b6 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:31.981568 dv-cinder-master-3-smb devstack@n-api.service[120109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:45:31.981568 dv-cinder-master-3-smb devstack@n-api.service[120109]: warnings.warn(msg) May 23 12:45:31.982797 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-0af602a8-1942-4724-97a0-17fd0316c6b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:31.983247 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-0af602a8-1942-4724-97a0-17fd0316c6b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:31.984038 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-0af602a8-1942-4724-97a0-17fd0316c6b6 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:31.984469 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-0af602a8-1942-4724-97a0-17fd0316c6b6 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:32.018779 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-0af602a8-1942-4724-97a0-17fd0316c6b6 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.156751 May 23 12:45:32.019349 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Mon May 23 12:45:31 2022] GET /compute/v2.1/os-services => generated 785 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:45:32.911614 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-e11e2037-81e5-4bad-902a-48c027c7c60d admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:32.912647 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-e11e2037-81e5-4bad-902a-48c027c7c60d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 23 12:45:32.913675 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:45:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:45:33.104055 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-c0194fc3-f568-48e9-97e8-4467455bede9 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:33.105261 dv-cinder-master-3-smb devstack@n-api.service[120109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:45:33.105261 dv-cinder-master-3-smb devstack@n-api.service[120109]: warnings.warn(msg) May 23 12:45:33.106502 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-c0194fc3-f568-48e9-97e8-4467455bede9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:33.106932 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-c0194fc3-f568-48e9-97e8-4467455bede9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:33.107757 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-c0194fc3-f568-48e9-97e8-4467455bede9 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:33.108193 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-c0194fc3-f568-48e9-97e8-4467455bede9 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:33.127531 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-c0194fc3-f568-48e9-97e8-4467455bede9 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.075244 May 23 12:45:33.128022 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Mon May 23 12:45:33 2022] GET /compute/v2.1/os-services => generated 785 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:45:44.398113 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-e11e2037-81e5-4bad-902a-48c027c7c60d admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:44.399107 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-e11e2037-81e5-4bad-902a-48c027c7c60d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002022 May 23 12:45:44.399523 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:45:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:45:44.541844 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writing DB stats nova_cell0:SELECT=4 {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:44.542564 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writing DB stats nova_cell1:SELECT=4 {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:44.543175 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG dbcounter [-] [120109] Writing DB stats nova_api:SELECT=8 {{(pid=120109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:45:44.591946 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-7bde289a-4cab-487d-a0b5-cf1cdc67d4ec admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:44.593250 dv-cinder-master-3-smb devstack@n-api.service[120109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:45:44.593250 dv-cinder-master-3-smb devstack@n-api.service[120109]: warnings.warn(msg) May 23 12:45:44.594423 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-7bde289a-4cab-487d-a0b5-cf1cdc67d4ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:44.594862 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-7bde289a-4cab-487d-a0b5-cf1cdc67d4ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:44.595637 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-7bde289a-4cab-487d-a0b5-cf1cdc67d4ec admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:44.596089 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-7bde289a-4cab-487d-a0b5-cf1cdc67d4ec admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:44.620615 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-7bde289a-4cab-487d-a0b5-cf1cdc67d4ec admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1029 microversion: 2.90 time: 0.083201 May 23 12:45:44.621182 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Mon May 23 12:45:44 2022] GET /compute/v2.1/os-services => generated 1029 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:45:45.504515 dv-cinder-master-3-smb devstack@n-api.service[120110]: DEBUG nova.api.openstack.wsgi [None req-e11e2037-81e5-4bad-902a-48c027c7c60d admin admin] Calling method '>' {{(pid=120110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:45.505569 dv-cinder-master-3-smb devstack@n-api.service[120110]: INFO nova.api.openstack.requestlog [None req-e11e2037-81e5-4bad-902a-48c027c7c60d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 23 12:45:45.505965 dv-cinder-master-3-smb devstack@n-api.service[120110]: [pid: 120110|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Mon May 23 12:45:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:45:45.697202 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG nova.api.openstack.wsgi [None req-b8e53cce-59e3-4e62-8568-243682294653 admin admin] Calling method '>' {{(pid=120109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:45:45.698363 dv-cinder-master-3-smb devstack@n-api.service[120109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:45:45.698363 dv-cinder-master-3-smb devstack@n-api.service[120109]: warnings.warn(msg) May 23 12:45:45.699554 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-b8e53cce-59e3-4e62-8568-243682294653 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:45.699991 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-b8e53cce-59e3-4e62-8568-243682294653 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:45.700767 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-b8e53cce-59e3-4e62-8568-243682294653 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:45:45.701228 dv-cinder-master-3-smb devstack@n-api.service[120109]: DEBUG oslo_concurrency.lockutils [None req-b8e53cce-59e3-4e62-8568-243682294653 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:45:45.723389 dv-cinder-master-3-smb devstack@n-api.service[120109]: INFO nova.api.openstack.requestlog [None req-b8e53cce-59e3-4e62-8568-243682294653 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1029 microversion: 2.90 time: 0.079005 May 23 12:45:45.723931 dv-cinder-master-3-smb devstack@n-api.service[120109]: [pid: 120109|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Mon May 23 12:45:45 2022] GET /compute/v2.1/os-services => generated 1029 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:46:48.615706 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... May 23 12:46:48.636652 dv-cinder-master-3-smb devstack@n-api.service[120108]: Mon May 23 12:46:48 2022 - graceful shutdown triggered... May 23 12:46:48.637312 dv-cinder-master-3-smb devstack@n-api.service[120110]: Gracefully killing worker 2 (pid: 120110)... May 23 12:46:48.637694 dv-cinder-master-3-smb devstack@n-api.service[120109]: Gracefully killing worker 1 (pid: 120109)... May 23 12:46:49.617242 dv-cinder-master-3-smb devstack@n-api.service[120108]: worker 1 buried after 1 seconds May 23 12:46:49.617242 dv-cinder-master-3-smb devstack@n-api.service[120108]: worker 2 buried after 1 seconds May 23 12:46:49.617242 dv-cinder-master-3-smb devstack@n-api.service[120108]: goodbye to uWSGI. May 23 12:46:49.618804 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. May 23 12:46:49.619373 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. May 23 12:46:49.622802 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... May 23 12:46:49.641048 dv-cinder-master-3-smb devstack@n-api.service[134527]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 12:46:49 2022] *** May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: nodename: dv-cinder-master-3-smb May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: machine: x86_64 May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: clock source: unix May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: pcre jit disabled May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: detected number of CPU cores: 4 May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: current working directory: / May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: detected binary path: /usr/bin/uwsgi-core May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: your processes number limit is 47680 May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: your memory page size is 4096 bytes May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: detected max file descriptor number: 2048 May 23 12:46:49.658945 dv-cinder-master-3-smb devstack@n-api.service[134527]: lock engine: pthread robust mutexes May 23 12:46:49.659813 dv-cinder-master-3-smb devstack@n-api.service[134527]: thunder lock: enabled May 23 12:46:49.659813 dv-cinder-master-3-smb devstack@n-api.service[134527]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 12:46:49.659813 dv-cinder-master-3-smb devstack@n-api.service[134527]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 12:46:49.708635 dv-cinder-master-3-smb devstack@n-api.service[134527]: Python main interpreter initialized at 0x55876e0d09c0 May 23 12:46:49.708635 dv-cinder-master-3-smb devstack@n-api.service[134527]: python threads support enabled May 23 12:46:49.708635 dv-cinder-master-3-smb devstack@n-api.service[134527]: your server socket listen backlog is limited to 100 connections May 23 12:46:49.708635 dv-cinder-master-3-smb devstack@n-api.service[134527]: your mercy for graceful operations on workers is 90 seconds May 23 12:46:49.709098 dv-cinder-master-3-smb devstack@n-api.service[134527]: mapped 403077 bytes (393 KB) for 2 cores May 23 12:46:49.709098 dv-cinder-master-3-smb devstack@n-api.service[134527]: *** Operational MODE: preforking *** May 23 12:46:49.709337 dv-cinder-master-3-smb devstack@n-api.service[134527]: *** uWSGI is running in multiple interpreter mode *** May 23 12:46:49.709337 dv-cinder-master-3-smb devstack@n-api.service[134527]: spawned uWSGI master process (pid: 134527) May 23 12:46:49.709548 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. May 23 12:46:49.710117 dv-cinder-master-3-smb devstack@n-api.service[134527]: spawned uWSGI worker 1 (pid: 134546, cores: 1) May 23 12:46:49.710608 dv-cinder-master-3-smb devstack@n-api.service[134527]: spawned uWSGI worker 2 (pid: 134547, cores: 1) May 23 12:46:49.710871 dv-cinder-master-3-smb devstack@n-api.service[134527]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 12:46:50.905597 dv-cinder-master-3-smb devstack@n-api.service[134547]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 12:46:50.906223 dv-cinder-master-3-smb devstack@n-api.service[134546]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 12:46:51.733821 dv-cinder-master-3-smb devstack@n-api.service[134546]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:46:51.733821 dv-cinder-master-3-smb devstack@n-api.service[134546]: from cryptography.utils import int_from_bytes May 23 12:46:51.734153 dv-cinder-master-3-smb devstack@n-api.service[134546]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:46:51.734153 dv-cinder-master-3-smb devstack@n-api.service[134546]: from cryptography.utils import int_from_bytes May 23 12:46:51.737173 dv-cinder-master-3-smb devstack@n-api.service[134547]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:46:51.737173 dv-cinder-master-3-smb devstack@n-api.service[134547]: from cryptography.utils import int_from_bytes May 23 12:46:51.737515 dv-cinder-master-3-smb devstack@n-api.service[134547]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:46:51.737515 dv-cinder-master-3-smb devstack@n-api.service[134547]: from cryptography.utils import int_from_bytes May 23 12:46:54.213072 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:46:54.213679 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:46:54.213981 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:46:54.214254 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:46:54.214504 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:46:54.214892 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.215226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.215551 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.216269 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.216612 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.216927 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.217287 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.217614 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.217943 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.218249 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.218573 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.219069 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.219310 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.219523 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.219834 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.220159 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.220803 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.221127 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.221456 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.221958 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.223456 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.223456 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.223456 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.223456 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.223791 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.224017 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.224251 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.224566 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.224884 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.225220 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.225625 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.225955 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.226268 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.226576 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.226984 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.227321 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.227631 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.227957 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.228270 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.228594 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.229461 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.229782 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.230105 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.230401 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.230703 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.231605 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.231936 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.232265 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.232574 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.232885 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.233188 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.233716 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.234119 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.234450 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.234779 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.235042 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.235288 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.235609 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.235930 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.236243 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.236552 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.236859 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.237183 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.237496 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.237804 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.238114 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.238422 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.238737 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.239173 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.239418 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.239657 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.239977 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.240389 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.240642 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.240954 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.241356 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.241642 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.241952 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.242274 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.242599 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.242908 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.243216 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.243524 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.243844 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.244165 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.244552 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.244906 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.245633 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.245953 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.246268 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.246575 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.246892 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.247236 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.247575 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.247937 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.248249 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.248557 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.248865 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.249196 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.249505 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.249815 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.250122 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.250432 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.250751 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.251077 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.251445 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.251756 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.252065 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.252372 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.252697 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.253004 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.253335 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.253656 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.253966 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.254272 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.254589 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.254895 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.255200 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.255515 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.255815 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.256121 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.256437 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.256742 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.257048 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.257375 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.257675 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.257977 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.258281 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.258584 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.258889 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.259188 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.259503 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.259823 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.260256 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.260715 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.261032 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.261383 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.261731 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.262068 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.262414 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.262740 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.263077 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.263411 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.263733 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.264047 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.264363 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.264688 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.265001 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.265338 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.265652 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.265972 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.266290 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.266621 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.266940 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.267259 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.267580 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.267892 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.268279 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.268610 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.268934 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.269307 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.269699 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.270087 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.270405 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.270776 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.271105 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.271419 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.271733 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.272049 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.272983 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.273351 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.273673 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.273994 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.274487 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.274824 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.275123 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.275602 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.276098 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.276443 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.276770 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.277166 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.277558 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.277886 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.278203 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.278520 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.278834 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.279140 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.279448 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.279755 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.280067 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.280373 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.280695 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.281024 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.281356 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.281692 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.282000 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.282314 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.282630 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.282942 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.283252 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.283567 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.283880 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.284204 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.284512 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.284821 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.285127 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.285473 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.285782 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.286088 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.286408 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.286719 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.287031 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.287341 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.287652 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.287976 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.288372 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.288689 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.289027 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.289379 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.289686 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.289939 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:46:54.290449 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.290449 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.290752 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:46:54.290932 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.290932 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.291229 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.292313 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:46:54.292556 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.292556 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.292837 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:46:54.292983 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.293236 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:46:54.293406 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.293406 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.293703 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.293856 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.293856 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.294153 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.294305 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.294484 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.294637 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.294793 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.295042 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.295208 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.295354 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.295642 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.295794 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.295939 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.296299 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.296422 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.296613 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.296916 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.297077 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.297324 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.297563 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.297725 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.297990 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.298166 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.298327 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.298625 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.298790 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.298958 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.299226 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.299432 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.299644 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.299861 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.300022 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.300207 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.300358 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.300510 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.300656 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.300820 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.300974 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.301129 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.301320 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.301466 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.301618 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.301772 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.301925 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.302070 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.302215 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.302360 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.302654 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.302815 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.302997 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.303142 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.303287 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.303438 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.303593 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.303738 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.303927 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.304080 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.304224 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.304375 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.304533 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.304687 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.304839 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.305295 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.305463 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.305629 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.305783 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.305928 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.306073 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.306224 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.306224 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.306512 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.306663 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.306823 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.307544 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.307745 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.307903 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.308059 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.308205 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.308205 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.308490 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.308635 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.308780 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.308933 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.309078 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.309256 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.309414 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.309568 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.309721 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.309880 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.310033 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.310178 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.310330 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.310475 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.310620 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.310775 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.310921 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.311066 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.311209 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.311362 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.311589 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.311739 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.311896 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.312042 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.312185 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.312330 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.312484 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.312638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.312791 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.312943 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.313096 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.313280 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.313456 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.313608 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.313766 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.313918 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.314063 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.314215 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.314390 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.314538 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.314682 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.314830 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.314982 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.315143 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.315309 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.315456 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.315609 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.315756 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.315901 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.316068 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.316215 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.316366 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.316520 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.316520 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.316810 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.316973 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.317128 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.317316 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.317470 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.317622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.317777 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.317924 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.318075 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.318228 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.318373 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.318517 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.318670 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.318670 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.318953 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.318953 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.319237 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.319382 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.319535 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.319681 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.319825 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.319825 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.320107 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.320266 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.320412 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.320557 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.320701 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.320853 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.321005 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.321178 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.321331 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.321475 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.321619 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.321773 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.321925 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.322080 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.322225 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.322376 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.322553 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.322553 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.322844 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.323004 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.323149 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.323420 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.323585 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.323739 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.323898 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.324051 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.324198 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.324349 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.324499 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.324651 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.324817 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.324979 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.325158 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.325334 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.325481 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.325626 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.325783 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.325937 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.326088 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.326233 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.326407 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.326558 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.326712 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.326857 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.327020 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.327164 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.327309 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.327461 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.327621 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.327766 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.327918 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.328064 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.328209 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.328361 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.328563 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.328716 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.328878 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.329031 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.329257 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.329425 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.329572 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.329772 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.329923 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.330078 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.330231 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.330376 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.330529 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.330675 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.330829 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.330985 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.331137 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.331290 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.331442 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.331596 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.331741 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.331885 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.332036 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.332194 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.332347 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.332492 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.333221 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.333398 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.333560 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.333717 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.333863 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.334006 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.334161 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.334307 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.334465 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.334617 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.334781 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.334929 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.335081 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.335226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.335394 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.335547 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.335701 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.335853 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.335999 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.336152 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.336299 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.336450 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.336596 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.336748 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.336895 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.337054 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.337246 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.337418 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.337567 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.337567 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.337849 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.338007 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.338184 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.338344 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.338344 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.338626 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.338772 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.338999 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.339148 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.339312 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.339465 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.339619 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.339777 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.339932 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.340077 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:46:54.340077 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.340365 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.340510 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.340663 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.340808 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.340953 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.341105 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.341298 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.341454 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.341614 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.341760 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.341912 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.342055 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.342199 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.342353 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.342506 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.342779 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.343087 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.343239 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.343409 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.343555 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.343700 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.343843 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.343988 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.344263 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.344432 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.344604 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.344762 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.344917 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.345098 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.345287 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.345786 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.345962 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.346116 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.346269 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.346420 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.346690 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.346860 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.347011 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.347160 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.347312 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.347469 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.347634 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.347793 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.347979 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.348147 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.348309 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.348460 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.348619 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.348778 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.348929 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.349095 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.349328 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.349484 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.349645 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.349803 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.349954 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.350115 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.350266 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.350435 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.350435 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.350723 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.350873 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.351023 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.351172 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.351336 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.351488 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.351638 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.351787 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.351944 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.352104 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.352267 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.352418 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.352568 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.352717 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.352903 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.353059 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.353271 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.353428 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.353579 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.353728 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.354414 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.354587 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.354753 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.354917 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.355078 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.355236 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.355236 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.355532 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.355683 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.355844 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.356001 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.356167 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.356318 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.356477 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.356645 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.356805 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.356956 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.357107 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.357278 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.357407 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.357507 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.357603 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.357690 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.357774 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.357864 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.358072 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.358178 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.358386 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.358491 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.358723 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.358828 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.359032 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.359133 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.359345 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.359438 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.359659 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.359761 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.359973 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.360076 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.360280 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.360380 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.360591 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.360697 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.360904 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.360996 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.361229 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.361325 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.361550 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.361656 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.361860 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.361960 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.362166 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.362266 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.362469 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.362561 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.362773 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.362873 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.363078 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.363190 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.363390 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.363484 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.363699 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.363791 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.364009 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.364108 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.364321 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.364438 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.364635 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.364813 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.364991 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.365226 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.365387 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.365546 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.365698 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.365848 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.365998 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.366163 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.366314 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.366475 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.366626 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.366777 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.366927 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.367091 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.367250 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.367411 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.367561 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.367711 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.367870 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.368032 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.368190 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.368350 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.368518 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.368677 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.368841 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.368993 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.369184 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.369345 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.370055 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.370220 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.370383 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.370547 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.370699 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.370699 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.371000 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.371169 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.371330 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.371490 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.371650 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.371802 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.371952 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.372116 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.372348 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.372523 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.372732 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.372888 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.373048 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.373249 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.373413 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.373573 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.373724 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.373874 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.374024 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.374187 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.374347 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.374499 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.374688 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.374842 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.375001 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.375165 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.375328 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.375479 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.375639 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.375799 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.375951 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.376112 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.376271 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.376430 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.376582 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.376741 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.376902 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.377055 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.377238 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.377401 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.377564 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.377724 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.377885 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.378037 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.378187 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.378345 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.378504 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.378655 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.378825 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.379133 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.379282 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.379449 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.379601 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.379832 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.379993 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.380144 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.380295 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.380445 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.380609 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.380776 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.380776 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.381070 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.381257 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.381429 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.381591 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.381743 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.381903 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.382060 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.382060 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.382345 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.382504 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.382925 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.383092 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.383092 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.383389 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.383547 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.383547 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.383855 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.384012 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.384012 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.384312 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.384464 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.384464 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.384772 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.384923 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.385183 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.385358 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.385358 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.385658 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.385825 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.386130 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.386312 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.386466 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.386679 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.386838 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.386997 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.387247 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.387414 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.387603 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.387840 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.387999 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.388209 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.388405 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.388564 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.388807 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.388974 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.389169 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.389445 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.389638 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.389805 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.390053 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.390235 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.390393 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.390654 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.390869 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.391035 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.391346 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.391512 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.391768 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.391993 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.392152 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.392475 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.392648 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.392800 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.392959 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.393117 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.393316 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.393482 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.393646 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.393805 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.393964 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.394121 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.394281 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.394446 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.394598 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.394748 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.394898 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.395049 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.395199 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.395363 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.395527 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.395685 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.395837 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.395986 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.396137 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.396300 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.396460 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.396613 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.396765 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.396921 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.397072 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.397258 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.397421 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.397583 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.397741 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.397899 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.398060 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.398218 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.398370 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.398528 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.398688 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.398839 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.399000 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.399152 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.399304 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.399472 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.399624 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.399794 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.399957 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.400109 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.400267 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.400419 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.400578 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.400758 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.400924 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.401076 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.401271 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.401424 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.401596 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.401769 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.401924 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.402075 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.402225 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.402374 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.402524 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.402683 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.402837 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.402994 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.403154 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.403305 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.403456 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.403625 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.403777 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.403942 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.404100 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.404258 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.404418 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.404578 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.404737 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.404888 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.405048 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.405214 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.405388 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.405541 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.405710 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.405860 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.406019 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.406170 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.406330 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.406489 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.406648 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.406807 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.406967 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.407126 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.407290 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.407442 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.407603 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.407762 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.407915 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.408065 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.408065 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.408376 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.408527 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.408691 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.408849 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.409009 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.409211 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.409371 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.409522 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.409698 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.409858 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.410020 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.410173 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.410332 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.410482 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.410633 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.410792 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.411022 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.411182 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.411348 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.411513 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.411674 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.411843 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.412002 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.412154 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.412312 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.412472 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.412625 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.412782 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.412941 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.413099 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.413285 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.413452 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.413613 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.413787 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.413939 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.413939 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.414224 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.414390 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.414567 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.414721 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.414879 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.415039 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.415203 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.415203 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.415491 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.415648 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.415648 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.415961 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.416121 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.416121 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.416935 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.417085 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.417271 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.417500 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.417724 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.417967 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.418287 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.418446 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.418609 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.418847 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.419014 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.419213 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.419408 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.419567 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.419830 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.420002 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.420167 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.420448 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.420613 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.420769 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.421077 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.421285 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.421446 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.421746 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.421904 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.422055 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.422243 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.422409 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.422609 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.422771 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.422928 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.423173 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.423343 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.423513 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.423672 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.423824 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.423974 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.424134 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.424304 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.424463 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.424614 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.424773 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.424935 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.425093 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.425283 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.425448 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.425599 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.425749 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.425910 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.426071 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.426223 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.426373 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.426530 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.426691 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.426849 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.427009 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.427160 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.427311 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.427471 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.427635 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.427794 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.427945 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.428096 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.428253 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.428412 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.428572 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.428724 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.428724 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.429009 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.429211 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.429381 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.429556 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.429716 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.429923 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.430081 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.430232 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.430391 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.430544 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.430693 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.430858 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.431015 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.431174 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.431340 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.431493 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.431653 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.431812 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.432526 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.432687 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.432852 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.433005 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.433173 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.433173 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.433481 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.433632 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.433885 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.434047 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.434210 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.434369 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.434521 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.434684 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.434843 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.435002 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.435153 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.435303 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.435463 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.435627 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.435785 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.435951 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.436103 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.436271 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.436424 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.436584 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.436743 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.436893 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.437051 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.437240 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.437399 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.437564 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.437723 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.437882 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.438033 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.438184 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.438354 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.438516 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.438668 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.438826 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.438978 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.439134 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.439299 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.439450 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.439609 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.439766 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.439918 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.440076 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.440241 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.440404 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.440563 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.440714 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.440883 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.441036 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.441256 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.441416 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.441576 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.441735 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.441887 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.442053 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.442205 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.442363 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.442543 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.442696 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.442854 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.443013 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.443165 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.443315 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.443466 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.443616 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.443775 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.443940 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.444098 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.444098 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.444438 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.444591 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.444748 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.444910 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.445061 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.445258 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.445421 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.445574 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.445761 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.445928 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.446080 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.446245 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.446396 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.446565 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.446730 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.446883 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.447032 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.447182 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.447340 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.447492 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.447762 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.447925 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.448077 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.448237 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.448395 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.448547 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.448718 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.448877 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.449032 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.449032 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.449379 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.449544 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.449704 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.449854 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.450006 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.450156 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.450315 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.450481 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.450644 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.450805 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.450964 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.451117 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.451276 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.451276 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.451584 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.451736 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.451885 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.452042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.452194 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.452358 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.452509 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.452670 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.452819 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.452977 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.453161 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.453323 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.453483 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.453635 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.453785 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.453943 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.454103 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.454263 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.454421 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.454573 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.454734 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.454886 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.455050 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.455202 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.455361 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.455521 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.455671 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.455831 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.455990 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.456148 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.456307 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.456466 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.456636 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.456803 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.456954 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.457113 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.457289 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.457443 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.457594 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.457761 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.457920 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.458073 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.458223 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.458384 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.458553 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.458714 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.458873 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.459024 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.459181 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.459341 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.459503 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.459663 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.459822 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.459982 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.460132 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.460284 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.460448 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.460619 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.460782 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.460934 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.461084 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.461302 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.461466 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.461619 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.461769 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.461920 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.462071 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.462231 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.462389 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.462547 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.462709 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.462861 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.463018 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.463018 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.463956 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.464118 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.464271 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.464421 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.464572 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.464737 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.464890 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.465041 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.465236 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.465401 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.465401 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.465706 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.465866 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.466018 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.466168 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.466327 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.466486 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.466638 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.466796 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.466954 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.467106 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.467268 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.467432 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.467585 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.467742 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.467902 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.468053 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.468053 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.468357 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.468357 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.468643 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.468794 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.468953 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.469113 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.469319 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.469474 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.469633 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.469785 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.469944 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.470105 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.470256 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.470256 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.470796 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.470954 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.471117 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.471279 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.471439 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.471600 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.471759 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.471910 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.472069 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.472239 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.472393 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.472580 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.472742 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.472901 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.473053 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.473285 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.473401 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.473498 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.473588 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.473685 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.473782 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.473868 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.473958 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474049 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474134 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474216 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474312 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474312 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474312 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474312 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474312 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474673 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474766 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474856 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.474940 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.475147 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.475243 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.475507 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.475607 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.475829 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.476050 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.476149 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.476400 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.476507 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.476752 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.476852 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.477063 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.477239 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.477394 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.477698 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.477793 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.478002 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.478101 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.478344 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.478444 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.478649 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.478808 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.479646 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.479753 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.480049 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.480239 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.480471 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.480597 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.480815 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.480913 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.481165 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.481281 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.481497 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.481600 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.481815 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.481917 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.482135 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.482240 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.482459 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.482555 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.482768 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.482869 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.483074 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.483179 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.483387 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.483488 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.483840 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.483941 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.484037 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.484133 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.484281 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.484428 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:46:54.484591 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.484899 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.485235 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.485542 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.485866 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.486171 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.486495 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.486806 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.487111 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.487416 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.487723 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.488323 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.488900 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.489497 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.490069 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.490642 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.491248 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.491834 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.492443 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.493051 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.493699 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.494308 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.494920 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.495512 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.496127 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.496745 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.497378 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.497993 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.498608 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.499224 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.500258 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.500883 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.501524 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.502133 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.502739 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.503344 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.503947 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.504547 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.505122 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.505735 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.506323 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.506943 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.507563 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.508196 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.508822 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.509250 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.509597 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.509934 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.510496 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.510949 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.511283 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.511606 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.511935 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.512265 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.512631 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.513257 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.513857 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.514464 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.515073 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.515679 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.516285 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.516888 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.517511 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.518085 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.518710 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.519275 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.519871 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.520473 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.521076 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.522100 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.522705 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.523346 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.523973 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.524600 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.525233 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.526369 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.526978 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.527566 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.528149 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.528755 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.529384 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.529987 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.531260 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.531260 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.531792 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.532411 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.533181 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.534034 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.534669 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.535271 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.535978 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.536500 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.537102 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.537721 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.538328 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.538925 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.539524 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.540147 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.540747 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.541408 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.542481 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.543082 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.543682 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.544038 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO dbcounter [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Registered counter for database nova_api May 23 12:46:54.544271 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.544872 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.545496 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.546123 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.546707 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.547281 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.547861 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.548438 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.548970 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.549542 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.550105 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.550663 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.551251 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.551822 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.552406 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.553021 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.553645 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.554227 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.554827 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.555480 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.556087 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.556618 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.556983 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.557362 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.557699 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.558043 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.558377 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.558703 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.559363 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.559363 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.559965 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.560344 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.560642 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.560965 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.561332 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.561648 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.561963 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.562278 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.562610 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.562926 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.563238 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.563564 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.563916 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.564234 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.564549 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.564643 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_db.sqlalchemy.engines [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:46:54.564863 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.565274 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.565589 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.565903 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.566217 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.566528 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.566845 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.567190 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.567513 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.567835 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.568153 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.568484 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.568785 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.569095 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.569432 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.569740 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.570061 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.570390 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.570707 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.571010 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.571434 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.571748 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.572067 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.572388 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.572864 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.572979 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writer thread running {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:46:54.573466 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.573843 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.574161 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.574488 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.574804 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.575135 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.575476 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.575806 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.576134 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.576442 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.576751 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.577055 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.577390 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.577711 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.578022 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.578325 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.578629 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.578938 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.579327 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.579626 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.579938 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.580246 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.580553 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.580855 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.581173 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.581480 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.581783 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.582085 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.582386 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.582694 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.582997 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.583300 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.583599 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.583902 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.584204 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.584533 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.585010 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.585622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.586211 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.586787 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.587365 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.587918 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.589028 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.589740 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.590335 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.590925 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.591555 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.592144 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.592741 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.593373 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.593977 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.594565 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.595153 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.596005 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.596593 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.597192 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.597711 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.598055 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.598426 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.599027 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.599445 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.599802 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.600167 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.600505 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.600837 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.601303 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.601632 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.602010 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.602338 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.602675 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.603011 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.603417 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.604343 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.604954 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.605358 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.605740 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.606096 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.606434 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.606761 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.607079 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.607391 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:46:54.607637 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:46:54.630480 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.context [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),42607727-9048-45c2-8317-fc63a315fdc3(cell1) {{(pid=134546) load_cells /opt/stack/nova/nova/context.py:464}} May 23 12:46:54.634637 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:54.636340 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:54.637165 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:54.639195 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:54.641186 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO dbcounter [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Registered counter for database nova_cell0 May 23 12:46:54.645187 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO dbcounter [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Registered counter for database nova_cell1 May 23 12:46:54.653173 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_db.sqlalchemy.engines [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:46:54.654375 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_db.sqlalchemy.engines [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:46:54.660790 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writer thread running {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:46:54.662882 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writer thread running {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:46:54.679415 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO dbcounter [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Registered counter for database nova_api May 23 12:46:54.703262 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_db.sqlalchemy.engines [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:46:54.711770 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writer thread running {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:46:54.770202 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.context [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),42607727-9048-45c2-8317-fc63a315fdc3(cell1) {{(pid=134547) load_cells /opt/stack/nova/nova/context.py:464}} May 23 12:46:54.774274 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:54.776451 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:54.777461 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:46:54.779476 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:46:54.781503 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO dbcounter [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Registered counter for database nova_cell0 May 23 12:46:54.787562 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO dbcounter [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Registered counter for database nova_cell1 May 23 12:46:54.795757 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_db.sqlalchemy.engines [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:46:54.797996 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_db.sqlalchemy.engines [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:46:54.803032 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writer thread running {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:46:54.808952 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writer thread running {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:46:54.814492 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO dbcounter [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Registered counter for database nova_cell0 May 23 12:46:54.824478 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_db.sqlalchemy.engines [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:46:54.828970 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writer thread running {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:46:54.956894 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO dbcounter [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Registered counter for database nova_cell0 May 23 12:46:54.966497 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_db.sqlalchemy.engines [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:46:54.971440 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writer thread running {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:46:55.152867 dv-cinder-master-3-smb devstack@n-api.service[134546]: WARNING keystonemiddleware.auth_token [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:46:55.160188 dv-cinder-master-3-smb devstack@n-api.service[134546]: WARNING keystonemiddleware.auth_token [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:46:55.300616 dv-cinder-master-3-smb devstack@n-api.service[134547]: WARNING keystonemiddleware.auth_token [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:46:55.308258 dv-cinder-master-3-smb devstack@n-api.service[134547]: WARNING keystonemiddleware.auth_token [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:46:55.515794 dv-cinder-master-3-smb devstack@n-api.service[134546]: WARNING keystonemiddleware.auth_token [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:46:55.521784 dv-cinder-master-3-smb devstack@n-api.service[134546]: WARNING keystonemiddleware.auth_token [None req-9c0993b6-09f8-478e-9c85-530b75fc58c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:46:55.527953 dv-cinder-master-3-smb devstack@n-api.service[134546]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55876e0d09c0 pid: 134546 (default app) May 23 12:46:55.651312 dv-cinder-master-3-smb devstack@n-api.service[134547]: WARNING keystonemiddleware.auth_token [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 12:46:55.657611 dv-cinder-master-3-smb devstack@n-api.service[134547]: WARNING keystonemiddleware.auth_token [None req-1762f1cc-c951-4278-b050-7a7a73d1cace None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 12:46:55.662872 dv-cinder-master-3-smb devstack@n-api.service[134547]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55876e0d09c0 pid: 134547 (default app) May 23 12:47:37.633173 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=3 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:37.633979 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=3 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:37.634760 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=3 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:37.635574 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=3 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:38.613516 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=3 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:38.615216 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=3 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:38.616369 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=3 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:38.617910 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=3 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:39.339301 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-20dca280-6321-4c08-9c92-44c41124de49 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Action: 'create', calling method: .version_select at 0x7f6a3ccddca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1810512547", "metadata": {"Type": "work"}}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-20dca280-6321-4c08-9c92-44c41124de49 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Request method failure captured: May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 122 May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4Jpyfbyn8ALzRvKP9rqj7ryZC6uKl1elSXZMKW2_E4zc0oGkwjxFcr-dcr4ZBMORSP560jckxXQ5oIHJp_nWJP6slPKQD3j_ucoCWb6DIVgHJugUnv9gIrMsXAfp8cMTGTDoshmPnvrvqZDVdZ-tdkAa4lX0GTwczHnFTmiwmM71zw May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:47:39.375948 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesNegativeTest-1126933491 May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d4ede22d723b405ab615c7c3fb2bdbab May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1810512547", "metadata": {"Type": "work"}}} May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: May 23 12:47:39.377936 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1810512547', 'metadata': {'Type': 'work'}}}} May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise error May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi '#$%' May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:47:39.378982 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 12:47:39.380612 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 12:47:39.382159 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 12:47:39.382159 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.385884 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-20dca280-6321-4c08-9c92-44c41124de49 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:47:39.387769 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-20dca280-6321-4c08-9c92-44c41124de49 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.763717 May 23 12:47:39.388937 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1155 bytes} [Mon May 23 12:47:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1767 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 12:47:39.401107 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-68829986-4cf5-41fa-b60a-ffcad19a9430 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Action: 'create', calling method: .version_select at 0x7f6a3cbd5f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-221887797", "metadata": {"Type": "work"}}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-68829986-4cf5-41fa-b60a-ffcad19a9430 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Request method failure captured: May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 119 May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4Jpyfbyn8ALzRvKP9rqj7ryZC6uKl1elSXZMKW2_E4zc0oGkwjxFcr-dcr4ZBMORSP560jckxXQ5oIHJp_nWJP6slPKQD3j_ucoCWb6DIVgHJugUnv9gIrMsXAfp8cMTGTDoshmPnvrvqZDVdZ-tdkAa4lX0GTwczHnFTmiwmM71zw May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:47:39.407206 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesNegativeTest-1126933491 May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d4ede22d723b405ab615c7c3fb2bdbab May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-221887797", "metadata": {"Type": "work"}}} May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: May 23 12:47:39.408723 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-221887797', 'metadata': {'Type': 'work'}}}} May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise error May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi '0' May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:47:39.409712 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 12:47:39.411975 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 12:47:39.413829 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 12:47:39.413829 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.415262 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-68829986-4cf5-41fa-b60a-ffcad19a9430 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:47:39.416983 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-68829986-4cf5-41fa-b60a-ffcad19a9430 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021438 May 23 12:47:39.417718 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 2/2] 10.222.0.45 () {60 vars in 1155 bytes} [Mon May 23 12:47:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 12:47:39.439004 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-79d5ae9d-d956-4e7e-8110-b46187507e7f tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Action: 'create', calling method: .version_select at 0x7f6a3cbd50d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1762277754", "metadata": {"Type": "work"}}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-79d5ae9d-d956-4e7e-8110-b46187507e7f tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Request method failure captured: May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 119 May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4Jpyfbyn8ALzRvKP9rqj7ryZC6uKl1elSXZMKW2_E4zc0oGkwjxFcr-dcr4ZBMORSP560jckxXQ5oIHJp_nWJP6slPKQD3j_ucoCWb6DIVgHJugUnv9gIrMsXAfp8cMTGTDoshmPnvrvqZDVdZ-tdkAa4lX0GTwczHnFTmiwmM71zw May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:47:39.448709 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesNegativeTest-1126933491 May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d4ede22d723b405ab615c7c3fb2bdbab May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1762277754", "metadata": {"Type": "work"}}} May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: May 23 12:47:39.450233 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1762277754', 'metadata': {'Type': 'work'}}}} May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise error May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi '' May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:47:39.451394 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 12:47:39.454903 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 12:47:39.457112 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 12:47:39.457112 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:39.460993 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-79d5ae9d-d956-4e7e-8110-b46187507e7f tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:47:39.464377 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-79d5ae9d-d956-4e7e-8110-b46187507e7f tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.037354 May 23 12:47:39.469048 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 3/3] 10.222.0.45 () {60 vars in 1155 bytes} [Mon May 23 12:47:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 12:47:39.495689 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e3e92d9a-afcb-4657-b6df-091b27a86761 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Calling method '.version_select at 0x7f6a3cb8dca0>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:39.618069 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1635593786", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "networks": [{"uuid": "eb906e79-bd09-4464-a576-ee07027b23cf"}]}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:47:40.127788 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-e3e92d9a-afcb-4657-b6df-091b27a86761 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] HTTP exception thrown: Volume tempest-invalid-1036816095 could not be found. May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e3e92d9a-afcb-4657-b6df-091b27a86761 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Request method failure captured: May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1036816095 HTTP/1.1 May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4Jpyfbyn8ALzRvKP9rqj7ryZC6uKl1elSXZMKW2_E4zc0oGkwjxFcr-dcr4ZBMORSP560jckxXQ5oIHJp_nWJP6slPKQD3j_ucoCWb6DIVgHJugUnv9gIrMsXAfp8cMTGTDoshmPnvrvqZDVdZ-tdkAa4lX0GTwczHnFTmiwmM71zw May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:47:40.131889 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesNegativeTest-1126933491 May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d4ede22d723b405ab615c7c3fb2bdbab May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Volume tempest-invalid-1036816095 could not be found. May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'tempest-invalid-1036816095'} May 23 12:47:40.133188 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1036816095 could not be found. (HTTP 404) (Request-ID: req-fb0724d6-acb9-4e82-be37-05c2f79f843c) May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:40.133940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:47:40.135113 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1036816095 could not be found. May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:47:40.136376 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1036816095 could not be found. May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1036816095 could not be found. May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e3e92d9a-afcb-4657-b6df-091b27a86761 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Returning 404 to user: Volume tempest-invalid-1036816095 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e3e92d9a-afcb-4657-b6df-091b27a86761 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1036816095" status: 404 len: 99 microversion: 2.1 time: 0.647574 May 23 12:47:40.143074 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 4/4] 10.222.0.45 () {58 vars in 1217 bytes} [Mon May 23 12:47:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1036816095 => generated 99 bytes in 653 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 23 12:47:40.150694 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-bb3c0d53-886e-4287-b79f-35991bd6dbc6 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003988 May 23 12:47:40.151211 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 5/5] 10.222.0.45 () {58 vars in 1139 bytes} [Mon May 23 12:47:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 23 12:47:40.160873 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8cbb6295-6e41-4f87-8807-3fae42db6c19 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003612 May 23 12:47:40.165652 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 6/6] 10.222.0.45 () {58 vars in 1136 bytes} [Mon May 23 12:47:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 12:47:40.170727 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-da7dd96c-c38e-4822-8c44-ae424b160010 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Calling method '.version_select at 0x7f6a3cac70d0>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:40.263990 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-da7dd96c-c38e-4822-8c44-ae424b160010 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] HTTP exception thrown: Volume 4615c210-51e5-41e7-be2d-e0712ebd16f2 could not be found. May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-da7dd96c-c38e-4822-8c44-ae424b160010 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Request method failure captured: May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: DELETE /compute/v2.1/os-volumes/4615c210-51e5-41e7-be2d-e0712ebd16f2 HTTP/1.1 May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4Jpyfbyn8ALzRvKP9rqj7ryZC6uKl1elSXZMKW2_E4zc0oGkwjxFcr-dcr4ZBMORSP560jckxXQ5oIHJp_nWJP6slPKQD3j_ucoCWb6DIVgHJugUnv9gIrMsXAfp8cMTGTDoshmPnvrvqZDVdZ-tdkAa4lX0GTwczHnFTmiwmM71zw May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:47:40.266345 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesNegativeTest-1126933491 May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d4ede22d723b405ab615c7c3fb2bdbab May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Volume 4615c210-51e5-41e7-be2d-e0712ebd16f2 could not be found. May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': '4615c210-51e5-41e7-be2d-e0712ebd16f2'} May 23 12:47:40.268038 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4615c210-51e5-41e7-be2d-e0712ebd16f2 could not be found. (HTTP 404) (Request-ID: req-13e0dc4d-ba43-4b26-a1cb-1c762f9d38d6) May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:40.269202 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:47:40.272617 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4615c210-51e5-41e7-be2d-e0712ebd16f2 could not be found. May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 12:47:40.273848 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4615c210-51e5-41e7-be2d-e0712ebd16f2 could not be found. May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4615c210-51e5-41e7-be2d-e0712ebd16f2 could not be found. May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-da7dd96c-c38e-4822-8c44-ae424b160010 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Returning 404 to user: Volume 4615c210-51e5-41e7-be2d-e0712ebd16f2 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-da7dd96c-c38e-4822-8c44-ae424b160010 tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/4615c210-51e5-41e7-be2d-e0712ebd16f2" status: 404 len: 109 microversion: 2.1 time: 0.101192 May 23 12:47:40.275271 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 7/7] 10.222.0.45 () {58 vars in 1247 bytes} [Mon May 23 12:47:40 2022] DELETE /compute/v2.1/os-volumes/4615c210-51e5-41e7-be2d-e0712ebd16f2 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:47:40.278877 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d77b497b-8377-4073-a9f4-1c865a6863ba tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Calling method '.version_select at 0x7f6a3cac73a0>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:40.322614 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] validate_networks() for [('eb906e79-bd09-4464-a576-ee07027b23cf', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:47:40.865762 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-d77b497b-8377-4073-a9f4-1c865a6863ba tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] HTTP exception thrown: Volume c16207e4-c3d0-4488-9b91-950fade2ba3b could not be found. May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d77b497b-8377-4073-a9f4-1c865a6863ba tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Request method failure captured: May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/os-volumes/c16207e4-c3d0-4488-9b91-950fade2ba3b HTTP/1.1 May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4Jpyfbyn8ALzRvKP9rqj7ryZC6uKl1elSXZMKW2_E4zc0oGkwjxFcr-dcr4ZBMORSP560jckxXQ5oIHJp_nWJP6slPKQD3j_ucoCWb6DIVgHJugUnv9gIrMsXAfp8cMTGTDoshmPnvrvqZDVdZ-tdkAa4lX0GTwczHnFTmiwmM71zw May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:47:40.868684 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_64ad7f3247aa401e896ba1d99492bd70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesNegativeTest-1126933491 May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 64ad7f3247aa401e896ba1d99492bd70 May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesNegativeTest-1126933491 May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d4ede22d723b405ab615c7c3fb2bdbab May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesNegativeTest-1126933491-project May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Volume c16207e4-c3d0-4488-9b91-950fade2ba3b could not be found. May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'c16207e4-c3d0-4488-9b91-950fade2ba3b'} May 23 12:47:40.870413 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c16207e4-c3d0-4488-9b91-950fade2ba3b could not be found. (HTTP 404) (Request-ID: req-875b720e-7609-466f-81da-db6b56391205) May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:40.871733 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:47:40.873020 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c16207e4-c3d0-4488-9b91-950fade2ba3b could not be found. May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 12:47:40.874214 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c16207e4-c3d0-4488-9b91-950fade2ba3b could not be found. May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c16207e4-c3d0-4488-9b91-950fade2ba3b could not be found. May 23 12:47:40.875457 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:47:40.877539 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d77b497b-8377-4073-a9f4-1c865a6863ba tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] Returning 404 to user: Volume c16207e4-c3d0-4488-9b91-950fade2ba3b could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:47:40.878514 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d77b497b-8377-4073-a9f4-1c865a6863ba tempest-VolumesNegativeTest-1126933491 tempest-VolumesNegativeTest-1126933491-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c16207e4-c3d0-4488-9b91-950fade2ba3b" status: 404 len: 109 microversion: 2.1 time: 0.604020 May 23 12:47:40.879230 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 8/8] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:47:40 2022] GET /compute/v2.1/os-volumes/c16207e4-c3d0-4488-9b91-950fade2ba3b => generated 109 bytes in 605 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:47:40.893434 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c00e5cc3-cccf-40db-80df-c8cfb5b1b859 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3caabc10>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:41.080372 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c00e5cc3-cccf-40db-80df-c8cfb5b1b859 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f288a7e0-a712-4914-8118-c77322125bfe" status: 200 len: 351 microversion: 2.1 time: 0.199741 May 23 12:47:41.080956 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 9/9] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:47:40 2022] GET /compute/v2.1/os-volumes/f288a7e0-a712-4914-8118-c77322125bfe => generated 351 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:47:42.173457 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:47:42.174503 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:47:42.175119 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:47:42.175677 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:47:42.176536 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:47:42.203637 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:42.207839 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:42.209317 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:42.209919 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:42.294549 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Getting quotas for project e5d4c3ce33db4711835456d22e7bfdbb. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:47:42.318845 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Getting quotas for user ba74f13f2a1e445dab34258d50ec8012 and project e5d4c3ce33db4711835456d22e7bfdbb. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:47:42.361180 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:47:42.375326 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:47:42.581938 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ab09177d-d1d5-4115-ab63-c69535507719 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.983412 May 23 12:47:42.583159 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 1/10] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:47:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:47:42.597213 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-79b06074-2285-4993-a6f3-77e36ee15c03 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:42.602039 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-79b06074-2285-4993-a6f3-77e36ee15c03 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:42.966511 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-79b06074-2285-4993-a6f3-77e36ee15c03 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:42.995664 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-79b06074-2285-4993-a6f3-77e36ee15c03 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1215 microversion: 2.1 time: 0.406544 May 23 12:47:42.997828 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 10/11] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:47:42 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1215 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:43.538262 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8aef2f3e-0617-4594-a064-ee7c488e10dd tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3cad6c10>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:43.831245 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8aef2f3e-0617-4594-a064-ee7c488e10dd tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a66d6488-bed4-447f-a394-e8b2e166e55a" status: 200 len: 350 microversion: 2.1 time: 0.297357 May 23 12:47:43.832647 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 2/12] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:47:43 2022] GET /compute/v2.1/os-volumes/a66d6488-bed4-447f-a394-e8b2e166e55a => generated 350 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:47:44.014965 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-33786bf4-f565-4a3a-88cf-e456551e170e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:44.017516 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-33786bf4-f565-4a3a-88cf-e456551e170e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:44.259163 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-33786bf4-f565-4a3a-88cf-e456551e170e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:44.281856 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-33786bf4-f565-4a3a-88cf-e456551e170e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1215 microversion: 2.1 time: 0.270194 May 23 12:47:44.287667 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 11/13] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:47:44 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:45.319099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-98e47a80-edec-4339-93cc-a8187358f996 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:45.321110 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-98e47a80-edec-4339-93cc-a8187358f996 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:45.363550 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-98e47a80-edec-4339-93cc-a8187358f996 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:45.365725 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-98e47a80-edec-4339-93cc-a8187358f996 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:45.380361 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-98e47a80-edec-4339-93cc-a8187358f996 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:45.385456 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-98e47a80-edec-4339-93cc-a8187358f996 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:45.826687 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-98e47a80-edec-4339-93cc-a8187358f996 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:45.852336 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-0127713b-4046-4a8d-b798-e4db7c047134 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3ca7eca0>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:45.860476 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-98e47a80-edec-4339-93cc-a8187358f996 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1211 microversion: 2.1 time: 0.549283 May 23 12:47:45.881592 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 3/14] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:47:45 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1211 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:45.951846 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-0127713b-4046-4a8d-b798-e4db7c047134 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5e725e97-6c5f-4b86-9444-71c7bac415c6" status: 200 len: 351 microversion: 2.1 time: 0.109089 May 23 12:47:45.952941 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 12/15] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:47:45 2022] GET /compute/v2.1/os-volumes/5e725e97-6c5f-4b86-9444-71c7bac415c6 => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:47:45.969856 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-58e87ed5-1dbd-43cd-b661-68a85ffe66c0 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3c1d6b80>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:46.119906 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-58e87ed5-1dbd-43cd-b661-68a85ffe66c0 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.158720 May 23 12:47:46.120892 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 4/16] 10.222.0.45 () {58 vars in 1133 bytes} [Mon May 23 12:47:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:46.133891 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2dbb4a2b-287d-4a16-a956-2286926376bb tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3ca87430>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:46.272009 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2dbb4a2b-287d-4a16-a956-2286926376bb tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.142133 May 23 12:47:46.281231 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 13/17] 10.222.0.45 () {58 vars in 1148 bytes} [Mon May 23 12:47:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:47:46.287000 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e9c67661-11d3-420d-b183-3576fa11c78a tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3c16f280>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:46.424494 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e9c67661-11d3-420d-b183-3576fa11c78a tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.142146 May 23 12:47:46.432010 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 5/18] 10.222.0.45 () {58 vars in 1133 bytes} [Mon May 23 12:47:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:46.437391 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ff71328f-e71b-470f-a330-5b2d867a785f tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3ca87dc0>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:46.675716 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ff71328f-e71b-470f-a330-5b2d867a785f tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.242475 May 23 12:47:46.676906 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 14/19] 10.222.0.45 () {58 vars in 1166 bytes} [Mon May 23 12:47:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:47:46.690865 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f0c6a007-cf7a-4216-8440-52f582fe1737 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3c1959d0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:46.898737 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c3e17ef9-7166-49d6-bae0-3e778f51536e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:46.910065 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c3e17ef9-7166-49d6-bae0-3e778f51536e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:46.929161 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3e17ef9-7166-49d6-bae0-3e778f51536e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:46.937622 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3e17ef9-7166-49d6-bae0-3e778f51536e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:46.938491 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3e17ef9-7166-49d6-bae0-3e778f51536e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:46.938935 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3e17ef9-7166-49d6-bae0-3e778f51536e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:46.967205 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f0c6a007-cf7a-4216-8440-52f582fe1737 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.280171 May 23 12:47:46.968503 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 6/20] 10.222.0.45 () {58 vars in 1169 bytes} [Mon May 23 12:47:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:47:46.980158 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ca3948de-01b0-4a18-ad5a-737f27447219 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3c16f5e0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:47.251801 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ca3948de-01b0-4a18-ad5a-737f27447219 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.275277 May 23 12:47:47.252359 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 7/21] 10.222.0.45 () {58 vars in 1154 bytes} [Mon May 23 12:47:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:47:47.265732 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-379a9216-295e-4871-af5f-719363cfed50 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3d4c11f0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:47.533513 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-379a9216-295e-4871-af5f-719363cfed50 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.273237 May 23 12:47:47.541429 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 8/22] 10.222.0.45 () {58 vars in 1187 bytes} [Mon May 23 12:47:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:47:47.546518 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-04e84c8b-8849-4918-84c9-62c5eb025a23 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] Calling method '.version_select at 0x7f6a3c128280>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:47.556607 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c3e17ef9-7166-49d6-bae0-3e778f51536e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:47.584153 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c3e17ef9-7166-49d6-bae0-3e778f51536e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1273 microversion: 2.1 time: 0.689093 May 23 12:47:47.584735 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 15/23] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:47:46 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1273 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:47.783453 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-04e84c8b-8849-4918-84c9-62c5eb025a23 tempest-VolumesTestJSON-970103658 tempest-VolumesTestJSON-970103658-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.241459 May 23 12:47:47.795927 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 9/24] 10.222.0.45 () {58 vars in 1154 bytes} [Mon May 23 12:47:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:48.603729 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d6122705-1593-4c5c-b2a7-9eaaa4ea6733 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:48.604592 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d6122705-1593-4c5c-b2a7-9eaaa4ea6733 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:48.613517 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d6122705-1593-4c5c-b2a7-9eaaa4ea6733 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:48.621538 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d6122705-1593-4c5c-b2a7-9eaaa4ea6733 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:48.626057 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d6122705-1593-4c5c-b2a7-9eaaa4ea6733 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:48.626525 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d6122705-1593-4c5c-b2a7-9eaaa4ea6733 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:51.092086 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d6122705-1593-4c5c-b2a7-9eaaa4ea6733 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:51.115944 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d6122705-1593-4c5c-b2a7-9eaaa4ea6733 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 2.508662 May 23 12:47:51.119488 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 16/25] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:47:48 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:52.137084 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b8a23d21-240f-4e69-b2a3-de5481ccf856 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:52.139092 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b8a23d21-240f-4e69-b2a3-de5481ccf856 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:52.156663 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8a23d21-240f-4e69-b2a3-de5481ccf856 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:52.166437 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8a23d21-240f-4e69-b2a3-de5481ccf856 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:52.174194 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8a23d21-240f-4e69-b2a3-de5481ccf856 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:52.175331 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8a23d21-240f-4e69-b2a3-de5481ccf856 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:52.270581 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:52.346252 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=6 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:53.246774 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-5d33f9e6-116d-473e-acd3-a871c70c35fa req-a06e40c4-245c-4388-b1e8-4562933c18d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6724b3c-b905-49cb-b770-282ac7c347c1", "tag": "61a94da0-006a-4d97-888c-e1a433cec120"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:47:53.282016 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-5d33f9e6-116d-473e-acd3-a871c70c35fa req-a06e40c4-245c-4388-b1e8-4562933c18d8 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:53.282467 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-5d33f9e6-116d-473e-acd3-a871c70c35fa req-a06e40c4-245c-4388-b1e8-4562933c18d8 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:53.347116 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-5d33f9e6-116d-473e-acd3-a871c70c35fa req-a06e40c4-245c-4388-b1e8-4562933c18d8 service nova] Creating event network-changed:61a94da0-006a-4d97-888c-e1a433cec120 for instance d6724b3c-b905-49cb-b770-282ac7c347c1 on hv-cinder-maste May 23 12:47:53.347813 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-5d33f9e6-116d-473e-acd3-a871c70c35fa req-a06e40c4-245c-4388-b1e8-4562933c18d8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 12:47:53.349030 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c60e13ce-18f8-421c-9307-d0b76adb6b78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:53.349509 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c60e13ce-18f8-421c-9307-d0b76adb6b78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:53.350300 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c60e13ce-18f8-421c-9307-d0b76adb6b78 None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:53.350733 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c60e13ce-18f8-421c-9307-d0b76adb6b78 None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:53.382549 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.compute.rpcapi [None req-c60e13ce-18f8-421c-9307-d0b76adb6b78 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 12:47:53.383824 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c60e13ce-18f8-421c-9307-d0b76adb6b78 None None] Releasing lock "compute-rpcapi-router" {{(pid=134546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 12:47:53.443964 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c60e13ce-18f8-421c-9307-d0b76adb6b78 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.533123 May 23 12:47:53.444597 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 17/26] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:47:53.598103 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b8a23d21-240f-4e69-b2a3-de5481ccf856 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:53.617213 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b8a23d21-240f-4e69-b2a3-de5481ccf856 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 1.484696 May 23 12:47:53.628867 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 10/27] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:47:52 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:54.638658 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c4aa2b29-63ee-43cc-ba61-3d34a1451957 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:54.640212 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c4aa2b29-63ee-43cc-ba61-3d34a1451957 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:54.649524 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=4 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:47:54.654283 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c4aa2b29-63ee-43cc-ba61-3d34a1451957 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:54.659529 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c4aa2b29-63ee-43cc-ba61-3d34a1451957 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:54.660652 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c4aa2b29-63ee-43cc-ba61-3d34a1451957 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:54.661723 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c4aa2b29-63ee-43cc-ba61-3d34a1451957 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:56.310848 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c4aa2b29-63ee-43cc-ba61-3d34a1451957 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:56.322537 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c4aa2b29-63ee-43cc-ba61-3d34a1451957 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 1.691119 May 23 12:47:56.338918 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 18/28] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:47:54 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:57.349607 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-19076af9-7ef7-4e5e-8e1d-ac9b6002e2df tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:57.350224 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-19076af9-7ef7-4e5e-8e1d-ac9b6002e2df tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:57.381315 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-19076af9-7ef7-4e5e-8e1d-ac9b6002e2df tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:57.381786 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-19076af9-7ef7-4e5e-8e1d-ac9b6002e2df tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:57.382620 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-19076af9-7ef7-4e5e-8e1d-ac9b6002e2df tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:57.383058 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-19076af9-7ef7-4e5e-8e1d-ac9b6002e2df tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:58.233876 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-19076af9-7ef7-4e5e-8e1d-ac9b6002e2df tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:47:58.244237 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-19076af9-7ef7-4e5e-8e1d-ac9b6002e2df tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 0.899202 May 23 12:47:58.250468 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 11/29] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:47:57 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:47:58.768806 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-75b08dd1-8afd-410a-9219-eb3d77b60c79 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Action: 'create', calling method: .version_select at 0x7f6a3c1293a0>, body: {"keypair": {"name": "tempest-keypair-1956396379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwdKcvkq8+6dIdfaVdJ9TD3keDFSVmXiwy6rTmEHCzyhXJYtHVRHGR0YqF1O+7A2hh3Zk+Ym6MRJM+aqoVjOUTaDqbSfXVZ541gp8Agn8SDlRfz/VBW1NJYyE7THdKC8g=="}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:47:58.891979 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-75b08dd1-8afd-410a-9219-eb3d77b60c79 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Getting quotas for project d6700b35745e4290b820f91719b249d4. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:47:58.912675 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-75b08dd1-8afd-410a-9219-eb3d77b60c79 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Getting quotas for user d23ca857b76540ce83053424b710697b and project d6700b35745e4290b820f91719b249d4. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:47:59.005588 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-75b08dd1-8afd-410a-9219-eb3d77b60c79 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.320797 May 23 12:47:59.009497 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 19/30] 10.222.0.45 () {62 vars in 1199 bytes} [Mon May 23 12:47:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1325 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 12:47:59.267389 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-266c9c40-de2d-4a23-a83c-d5762122bfe0 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:47:59.268435 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-266c9c40-de2d-4a23-a83c-d5762122bfe0 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:47:59.286538 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-266c9c40-de2d-4a23-a83c-d5762122bfe0 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:59.292196 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-266c9c40-de2d-4a23-a83c-d5762122bfe0 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:47:59.295560 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-266c9c40-de2d-4a23-a83c-d5762122bfe0 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:47:59.298672 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-266c9c40-de2d-4a23-a83c-d5762122bfe0 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:00.349344 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-266c9c40-de2d-4a23-a83c-d5762122bfe0 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:00.373220 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-266c9c40-de2d-4a23-a83c-d5762122bfe0 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 1.105821 May 23 12:48:00.376358 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 12/31] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:47:59 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:00.495061 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f3ad8029-db22-4924-b5c6-cc7a3e765b8f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: .version_select at 0x7f6a3c155940>, body: {"keypair": {"name": "tempest-keypair-291890632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZXQmYzKWEJ8/JlE+myt9foYB31wzpwBAt65YkAC2EczyKwtuhfcaJRQ4ZYii6HeuyeOkq+vfOab0LY7+NTF+FUG3rPmlsZbpECYZEz18wwZwZTpjaBzQ0tP8CyrIfeuQ=="}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:00.556474 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-f3ad8029-db22-4924-b5c6-cc7a3e765b8f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:48:00.579750 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-f3ad8029-db22-4924-b5c6-cc7a3e765b8f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for user 2335faffe08d4c75ab85aa124819c513 and project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:48:00.681271 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f3ad8029-db22-4924-b5c6-cc7a3e765b8f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.255511 May 23 12:48:00.682557 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 20/32] 10.222.0.45 () {60 vars in 1158 bytes} [Mon May 23 12:47:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:01.395612 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a01e4470-07dc-484f-bb26-83bc90ee97ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:01.396895 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a01e4470-07dc-484f-bb26-83bc90ee97ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:01.422554 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a01e4470-07dc-484f-bb26-83bc90ee97ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:01.427672 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a01e4470-07dc-484f-bb26-83bc90ee97ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:01.446937 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a01e4470-07dc-484f-bb26-83bc90ee97ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:01.459378 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a01e4470-07dc-484f-bb26-83bc90ee97ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:02.190683 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a01e4470-07dc-484f-bb26-83bc90ee97ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:02.205061 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a01e4470-07dc-484f-bb26-83bc90ee97ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 0.815871 May 23 12:48:02.207655 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 13/33] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:01 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:03.224189 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c52c5662-a03b-4931-ab27-523afc2556ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:03.227727 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c52c5662-a03b-4931-ab27-523afc2556ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:03.249533 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c52c5662-a03b-4931-ab27-523afc2556ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:03.249983 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c52c5662-a03b-4931-ab27-523afc2556ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:03.250789 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c52c5662-a03b-4931-ab27-523afc2556ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:03.251238 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c52c5662-a03b-4931-ab27-523afc2556ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:03.374440 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=2 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:03.795076 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c52c5662-a03b-4931-ab27-523afc2556ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:03.810242 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c52c5662-a03b-4931-ab27-523afc2556ec tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 0.588859 May 23 12:48:03.835148 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 21/34] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:03 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:04.725646 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1803939089", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "971dea61-5b31-4843-b112-31eacccec712"}], "security_groups": [{"name": "tempest-securitygroup--1574150940"}], "key_name": "tempest-keypair-1956396379", "user_data": "}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:04.847738 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-cdaa7ae1-e540-4c40-9433-069163ef7886 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:04.848444 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-cdaa7ae1-e540-4c40-9433-069163ef7886 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:04.857315 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cdaa7ae1-e540-4c40-9433-069163ef7886 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:04.859564 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cdaa7ae1-e540-4c40-9433-069163ef7886 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:04.861330 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cdaa7ae1-e540-4c40-9433-069163ef7886 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:04.864110 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cdaa7ae1-e540-4c40-9433-069163ef7886 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:04.939204 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] validate_networks() for [('971dea61-5b31-4843-b112-31eacccec712', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:48:05.266106 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-cdaa7ae1-e540-4c40-9433-069163ef7886 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:05.274181 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-cdaa7ae1-e540-4c40-9433-069163ef7886 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 0.436750 May 23 12:48:05.278732 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 22/35] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:04 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:05.297611 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-276495696", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6101120e-4403-4c14-bcc5-167e49bfb907"}], "security_groups": [{"name": "tempest-securitygroup--289909401"}], "key_name": "tempest-keypair-291890632", "user_data": "}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:05.581802 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.network.neutron [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] validate_networks() for [('6101120e-4403-4c14-bcc5-167e49bfb907', None, None, None, None, None)] {{(pid=134546) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:48:05.846239 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:48:05.846695 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:48:05.847128 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:48:05.847542 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:48:05.847955 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:48:05.869970 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:05.870894 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:05.871800 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:05.872245 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:05.920133 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Getting quotas for project d6700b35745e4290b820f91719b249d4. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:48:05.938819 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Getting quotas for user d23ca857b76540ce83053424b710697b and project d6700b35745e4290b820f91719b249d4. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:48:05.958103 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:48:05.965011 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:48:06.055340 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a2201033-0280-4d4e-b26a-a8772db65e02 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.335785 May 23 12:48:06.068028 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 14/36] 10.222.0.45 () {62 vars in 1187 bytes} [Mon May 23 12:48:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 12:48:06.081548 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7c2c7008-ad52-47df-b71c-666cb5455fe1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:06.088206 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7c2c7008-ad52-47df-b71c-666cb5455fe1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:06.222168 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7c2c7008-ad52-47df-b71c-666cb5455fe1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:06.242636 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7c2c7008-ad52-47df-b71c-666cb5455fe1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:06.250217 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7c2c7008-ad52-47df-b71c-666cb5455fe1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:06.253121 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7c2c7008-ad52-47df-b71c-666cb5455fe1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1282 microversion: 2.20 time: 0.181821 May 23 12:48:06.253900 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 15/37] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:06 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:06.298443 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-380e2d1c-46ca-4962-8485-048af588782f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:06.299310 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-380e2d1c-46ca-4962-8485-048af588782f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:06.318120 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-380e2d1c-46ca-4962-8485-048af588782f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:06.318679 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-380e2d1c-46ca-4962-8485-048af588782f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:06.321208 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-380e2d1c-46ca-4962-8485-048af588782f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:06.321739 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-380e2d1c-46ca-4962-8485-048af588782f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:06.658416 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-380e2d1c-46ca-4962-8485-048af588782f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:06.670268 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-380e2d1c-46ca-4962-8485-048af588782f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 0.379285 May 23 12:48:06.674080 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 16/38] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:06 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:07.277883 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-40b00f33-e4bf-4bc0-b97b-a36ee8d08cd1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:07.281705 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-40b00f33-e4bf-4bc0-b97b-a36ee8d08cd1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:07.304279 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-40b00f33-e4bf-4bc0-b97b-a36ee8d08cd1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:07.304759 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-40b00f33-e4bf-4bc0-b97b-a36ee8d08cd1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:07.307256 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-40b00f33-e4bf-4bc0-b97b-a36ee8d08cd1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:07.307256 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-40b00f33-e4bf-4bc0-b97b-a36ee8d08cd1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:07.411584 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Flavor limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:48:07.412382 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Image limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:48:07.416005 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Flavor pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:48:07.416552 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Image pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:48:07.417986 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:48:07.450029 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:07.451137 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:07.452610 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:07.455516 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:07.512264 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-40b00f33-e4bf-4bc0-b97b-a36ee8d08cd1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:07.524404 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-40b00f33-e4bf-4bc0-b97b-a36ee8d08cd1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:07.527657 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-40b00f33-e4bf-4bc0-b97b-a36ee8d08cd1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:07.529067 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-40b00f33-e4bf-4bc0-b97b-a36ee8d08cd1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1286 microversion: 2.20 time: 0.260396 May 23 12:48:07.529932 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 17/39] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:07 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1286 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:07.555837 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:48:07.571055 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for user 2335faffe08d4c75ab85aa124819c513 and project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:48:07.599047 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Going to run 1 instances... {{(pid=134546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:48:07.607014 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:48:07.670060 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=2 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:07.691765 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c46bc495-abfe-43ee-8bf3-a65f990ae8a5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:07.692750 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c46bc495-abfe-43ee-8bf3-a65f990ae8a5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:07.713864 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c46bc495-abfe-43ee-8bf3-a65f990ae8a5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:07.714343 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c46bc495-abfe-43ee-8bf3-a65f990ae8a5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:07.715228 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c46bc495-abfe-43ee-8bf3-a65f990ae8a5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:07.715550 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c46bc495-abfe-43ee-8bf3-a65f990ae8a5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:07.744472 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-bb8472c2-d71b-46d8-b72e-0593a5550b64 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.462677 May 23 12:48:07.746176 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 23/40] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:48:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 2466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:48:07.758585 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-262ba5bc-2fd8-4682-a91b-dc73156e655e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:07.759508 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-262ba5bc-2fd8-4682-a91b-dc73156e655e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:07.986171 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-262ba5bc-2fd8-4682-a91b-dc73156e655e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:07.997421 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-262ba5bc-2fd8-4682-a91b-dc73156e655e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1240 microversion: 2.1 time: 0.243171 May 23 12:48:07.998653 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c46bc495-abfe-43ee-8bf3-a65f990ae8a5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:08.000336 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 24/41] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:07 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1240 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:08.007777 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c46bc495-abfe-43ee-8bf3-a65f990ae8a5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 0.320599 May 23 12:48:08.008907 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 18/42] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:07 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:08.548650 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-38d96ccf-8556-4e78-b8eb-79bd643e5706 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:08.550149 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-38d96ccf-8556-4e78-b8eb-79bd643e5706 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:08.562766 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-38d96ccf-8556-4e78-b8eb-79bd643e5706 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:08.564153 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-38d96ccf-8556-4e78-b8eb-79bd643e5706 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:08.567861 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-38d96ccf-8556-4e78-b8eb-79bd643e5706 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:08.568582 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-38d96ccf-8556-4e78-b8eb-79bd643e5706 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:08.574919 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=37 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:08.751150 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-38d96ccf-8556-4e78-b8eb-79bd643e5706 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:08.763133 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-38d96ccf-8556-4e78-b8eb-79bd643e5706 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:08.770280 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-38d96ccf-8556-4e78-b8eb-79bd643e5706 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:08.772235 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-38d96ccf-8556-4e78-b8eb-79bd643e5706 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1352 microversion: 2.20 time: 0.228037 May 23 12:48:08.773324 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 25/43] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:08 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1352 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:09.018746 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-58f57a40-f737-4124-9816-56857d67a17f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:09.019369 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-58f57a40-f737-4124-9816-56857d67a17f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:09.021939 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:09.026995 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-817cf5fc-3e29-41e6-9dfa-cdb2ee0dd61c tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:09.028318 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-817cf5fc-3e29-41e6-9dfa-cdb2ee0dd61c tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:09.036403 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-817cf5fc-3e29-41e6-9dfa-cdb2ee0dd61c tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:09.038989 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-817cf5fc-3e29-41e6-9dfa-cdb2ee0dd61c tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:09.041371 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-817cf5fc-3e29-41e6-9dfa-cdb2ee0dd61c tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:09.043500 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-817cf5fc-3e29-41e6-9dfa-cdb2ee0dd61c tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:09.044358 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-58f57a40-f737-4124-9816-56857d67a17f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:09.044823 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-58f57a40-f737-4124-9816-56857d67a17f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:09.054581 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-58f57a40-f737-4124-9816-56857d67a17f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:09.055128 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-58f57a40-f737-4124-9816-56857d67a17f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:09.128678 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=53 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:09.223859 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-58f57a40-f737-4124-9816-56857d67a17f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:09.247951 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-58f57a40-f737-4124-9816-56857d67a17f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1292 microversion: 2.1 time: 0.234447 May 23 12:48:09.249075 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 19/44] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:09 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1292 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:09.486629 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-817cf5fc-3e29-41e6-9dfa-cdb2ee0dd61c tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:09.503818 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-817cf5fc-3e29-41e6-9dfa-cdb2ee0dd61c tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 0.481390 May 23 12:48:09.504766 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 26/45] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:09 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:09.791325 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-62f6ce3e-ec2e-4c79-abf7-7457f06af33f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:09.791900 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-62f6ce3e-ec2e-4c79-abf7-7457f06af33f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:09.806036 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-62f6ce3e-ec2e-4c79-abf7-7457f06af33f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:09.806493 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-62f6ce3e-ec2e-4c79-abf7-7457f06af33f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:09.807318 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-62f6ce3e-ec2e-4c79-abf7-7457f06af33f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:09.808364 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-62f6ce3e-ec2e-4c79-abf7-7457f06af33f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:10.271921 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-56d7d5bc-fd2b-463c-995d-c1a25683a47e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:10.272749 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-56d7d5bc-fd2b-463c-995d-c1a25683a47e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:10.303997 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-56d7d5bc-fd2b-463c-995d-c1a25683a47e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:10.311901 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-56d7d5bc-fd2b-463c-995d-c1a25683a47e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:10.313446 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-56d7d5bc-fd2b-463c-995d-c1a25683a47e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:10.314474 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-56d7d5bc-fd2b-463c-995d-c1a25683a47e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:10.366601 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-62f6ce3e-ec2e-4c79-abf7-7457f06af33f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:10.378358 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-62f6ce3e-ec2e-4c79-abf7-7457f06af33f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:10.379874 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-62f6ce3e-ec2e-4c79-abf7-7457f06af33f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:10.387254 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-62f6ce3e-ec2e-4c79-abf7-7457f06af33f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1408 microversion: 2.20 time: 0.600335 May 23 12:48:10.393661 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 20/46] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:09 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1408 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:48:10.497736 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-56d7d5bc-fd2b-463c-995d-c1a25683a47e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:10.512060 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-56d7d5bc-fd2b-463c-995d-c1a25683a47e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1298 microversion: 2.1 time: 0.246054 May 23 12:48:10.515453 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 27/47] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:10 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1298 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:10.528324 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c701e22d-2fad-43ab-a134-e87a7466cc0f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:10.528952 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c701e22d-2fad-43ab-a134-e87a7466cc0f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:10.543563 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c701e22d-2fad-43ab-a134-e87a7466cc0f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:10.544186 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c701e22d-2fad-43ab-a134-e87a7466cc0f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:10.545432 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c701e22d-2fad-43ab-a134-e87a7466cc0f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:10.546375 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c701e22d-2fad-43ab-a134-e87a7466cc0f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:11.041393 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-d169456b-2d63-40ad-989a-d6e3a6b6103e req-d5711a1e-f1ed-4884-87f3-50ff09ae0b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6724b3c-b905-49cb-b770-282ac7c347c1", "name": "network-vif-plugged", "status": "completed", "tag": "61a94da0-006a-4d97-888c-e1a433cec120"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:11.066926 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-d169456b-2d63-40ad-989a-d6e3a6b6103e req-d5711a1e-f1ed-4884-87f3-50ff09ae0b3a service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:11.068258 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-d169456b-2d63-40ad-989a-d6e3a6b6103e req-d5711a1e-f1ed-4884-87f3-50ff09ae0b3a service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:11.130317 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-d169456b-2d63-40ad-989a-d6e3a6b6103e req-d5711a1e-f1ed-4884-87f3-50ff09ae0b3a service nova] Creating event network-vif-plugged:61a94da0-006a-4d97-888c-e1a433cec120 for instance d6724b3c-b905-49cb-b770-282ac7c347c1 on hv-cinder-maste May 23 12:48:11.130879 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-d169456b-2d63-40ad-989a-d6e3a6b6103e req-d5711a1e-f1ed-4884-87f3-50ff09ae0b3a service nova] Acquired lock "compute-rpcapi-router" {{(pid=134547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 12:48:11.132162 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-073c2ec6-3c2e-4e43-97be-1a87e2151968 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:11.132772 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-073c2ec6-3c2e-4e43-97be-1a87e2151968 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:11.133758 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-073c2ec6-3c2e-4e43-97be-1a87e2151968 None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:11.136974 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-073c2ec6-3c2e-4e43-97be-1a87e2151968 None None] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:11.158786 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.compute.rpcapi [None req-073c2ec6-3c2e-4e43-97be-1a87e2151968 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 12:48:11.159919 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-073c2ec6-3c2e-4e43-97be-1a87e2151968 None None] Releasing lock "compute-rpcapi-router" {{(pid=134547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 12:48:11.181540 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c701e22d-2fad-43ab-a134-e87a7466cc0f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:11.195961 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c701e22d-2fad-43ab-a134-e87a7466cc0f tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 0.678138 May 23 12:48:11.199830 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 28/48] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:10 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:11.212164 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-073c2ec6-3c2e-4e43-97be-1a87e2151968 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.780312 May 23 12:48:11.212877 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 21/49] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:48:11.408002 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-67100fb5-b61d-41d8-9356-f76d5372affd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:11.408535 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-67100fb5-b61d-41d8-9356-f76d5372affd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:11.427742 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-67100fb5-b61d-41d8-9356-f76d5372affd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:11.428191 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-67100fb5-b61d-41d8-9356-f76d5372affd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:11.430207 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-67100fb5-b61d-41d8-9356-f76d5372affd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:11.430646 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-67100fb5-b61d-41d8-9356-f76d5372affd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:11.534841 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f29b27ec-0ebc-4ce1-ad4d-94703bb84baa tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:11.535651 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f29b27ec-0ebc-4ce1-ad4d-94703bb84baa tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:11.549802 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f29b27ec-0ebc-4ce1-ad4d-94703bb84baa tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:11.550242 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f29b27ec-0ebc-4ce1-ad4d-94703bb84baa tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:11.551233 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f29b27ec-0ebc-4ce1-ad4d-94703bb84baa tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:11.551930 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f29b27ec-0ebc-4ce1-ad4d-94703bb84baa tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:11.922953 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f29b27ec-0ebc-4ce1-ad4d-94703bb84baa tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:11.934662 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f29b27ec-0ebc-4ce1-ad4d-94703bb84baa tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1298 microversion: 2.1 time: 0.403872 May 23 12:48:11.935248 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 22/50] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:11 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1298 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:48:11.939664 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-01c50f96-0b68-45cd-aab1-cd716d62c2fe req-53eff2de-ceea-4922-8d0d-238a068550a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c365608-41a1-4663-b5e2-3481874a2325", "tag": "fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:11.968599 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-01c50f96-0b68-45cd-aab1-cd716d62c2fe req-53eff2de-ceea-4922-8d0d-238a068550a4 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:11.969800 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-01c50f96-0b68-45cd-aab1-cd716d62c2fe req-53eff2de-ceea-4922-8d0d-238a068550a4 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:11.988164 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-01c50f96-0b68-45cd-aab1-cd716d62c2fe req-53eff2de-ceea-4922-8d0d-238a068550a4 service nova] Creating event network-changed:fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1 for instance 0c365608-41a1-4663-b5e2-3481874a2325 on hv-cinder-maste May 23 12:48:11.995164 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-01c50f96-0b68-45cd-aab1-cd716d62c2fe req-53eff2de-ceea-4922-8d0d-238a068550a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058572 May 23 12:48:11.996755 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 23/51] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:12.166014 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-67100fb5-b61d-41d8-9356-f76d5372affd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:12.176109 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-67100fb5-b61d-41d8-9356-f76d5372affd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:12.178033 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-67100fb5-b61d-41d8-9356-f76d5372affd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:12.179674 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-67100fb5-b61d-41d8-9356-f76d5372affd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1408 microversion: 2.20 time: 0.776206 May 23 12:48:12.191362 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 29/52] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:11 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1408 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:12.216457 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-84098e1c-34ab-4d5e-9c24-86785f853355 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:12.217201 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-84098e1c-34ab-4d5e-9c24-86785f853355 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:12.230554 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-84098e1c-34ab-4d5e-9c24-86785f853355 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:12.230812 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-84098e1c-34ab-4d5e-9c24-86785f853355 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:12.231628 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-84098e1c-34ab-4d5e-9c24-86785f853355 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:12.232073 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-84098e1c-34ab-4d5e-9c24-86785f853355 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:12.748191 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-84098e1c-34ab-4d5e-9c24-86785f853355 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:12.770616 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-84098e1c-34ab-4d5e-9c24-86785f853355 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 0.558093 May 23 12:48:12.771266 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 24/53] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:12 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:12.957010 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-0f14a687-7e3d-4008-85f8-73d4e1ea5d24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:12.959281 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-0f14a687-7e3d-4008-85f8-73d4e1ea5d24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:12.974211 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0f14a687-7e3d-4008-85f8-73d4e1ea5d24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:12.974981 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0f14a687-7e3d-4008-85f8-73d4e1ea5d24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:12.977207 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0f14a687-7e3d-4008-85f8-73d4e1ea5d24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:12.977905 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0f14a687-7e3d-4008-85f8-73d4e1ea5d24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:13.199535 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-af3a3857-f489-40b0-b548-183eacf0451e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:13.200289 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-af3a3857-f489-40b0-b548-183eacf0451e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:13.210008 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-af3a3857-f489-40b0-b548-183eacf0451e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:13.210458 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-af3a3857-f489-40b0-b548-183eacf0451e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:13.212988 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-af3a3857-f489-40b0-b548-183eacf0451e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:13.216269 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-af3a3857-f489-40b0-b548-183eacf0451e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:13.461297 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-0f14a687-7e3d-4008-85f8-73d4e1ea5d24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:13.475994 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-0f14a687-7e3d-4008-85f8-73d4e1ea5d24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1365 microversion: 2.1 time: 0.527957 May 23 12:48:13.478285 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 30/54] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:12 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1365 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:13.551963 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-af3a3857-f489-40b0-b548-183eacf0451e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:13.566384 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-af3a3857-f489-40b0-b548-183eacf0451e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:13.569430 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-af3a3857-f489-40b0-b548-183eacf0451e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:13.573075 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-af3a3857-f489-40b0-b548-183eacf0451e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1408 microversion: 2.20 time: 0.376909 May 23 12:48:13.584450 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 25/55] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:13 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1408 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:13.788364 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c3952b33-c9a9-4298-a5e1-be353f68dca1 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:13.789176 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c3952b33-c9a9-4298-a5e1-be353f68dca1 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:13.799845 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3952b33-c9a9-4298-a5e1-be353f68dca1 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:13.801872 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3952b33-c9a9-4298-a5e1-be353f68dca1 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:13.803028 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3952b33-c9a9-4298-a5e1-be353f68dca1 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:13.805162 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3952b33-c9a9-4298-a5e1-be353f68dca1 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:14.140756 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c3952b33-c9a9-4298-a5e1-be353f68dca1 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:14.157020 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c3952b33-c9a9-4298-a5e1-be353f68dca1 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1315 microversion: 2.1 time: 0.371874 May 23 12:48:14.175244 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 31/56] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:13 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:14.507827 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-939e7ba5-2a4e-443a-83b5-8b13635ddb79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:14.515651 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-939e7ba5-2a4e-443a-83b5-8b13635ddb79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:14.541610 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-939e7ba5-2a4e-443a-83b5-8b13635ddb79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:14.542293 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-939e7ba5-2a4e-443a-83b5-8b13635ddb79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:14.543830 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-939e7ba5-2a4e-443a-83b5-8b13635ddb79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:14.544655 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-939e7ba5-2a4e-443a-83b5-8b13635ddb79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:14.594773 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-58a311a8-92f5-4593-b6c1-5b115fc5fb34 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:14.596252 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-58a311a8-92f5-4593-b6c1-5b115fc5fb34 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:14.610038 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-58a311a8-92f5-4593-b6c1-5b115fc5fb34 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:14.610993 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-58a311a8-92f5-4593-b6c1-5b115fc5fb34 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:14.611951 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-58a311a8-92f5-4593-b6c1-5b115fc5fb34 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:14.616927 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-58a311a8-92f5-4593-b6c1-5b115fc5fb34 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:14.908869 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-939e7ba5-2a4e-443a-83b5-8b13635ddb79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:14.917692 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-939e7ba5-2a4e-443a-83b5-8b13635ddb79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1365 microversion: 2.1 time: 0.425391 May 23 12:48:14.927586 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 26/57] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:14 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:15.175621 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-cccf9f6c-fbc5-417d-b776-794506c4767a tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:15.176542 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-cccf9f6c-fbc5-417d-b776-794506c4767a tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:15.185310 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cccf9f6c-fbc5-417d-b776-794506c4767a tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:15.189239 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cccf9f6c-fbc5-417d-b776-794506c4767a tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:15.190628 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cccf9f6c-fbc5-417d-b776-794506c4767a tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:15.192683 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cccf9f6c-fbc5-417d-b776-794506c4767a tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:15.408930 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-58a311a8-92f5-4593-b6c1-5b115fc5fb34 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:15.418997 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-58a311a8-92f5-4593-b6c1-5b115fc5fb34 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:15.420979 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-58a311a8-92f5-4593-b6c1-5b115fc5fb34 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:15.422359 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-58a311a8-92f5-4593-b6c1-5b115fc5fb34 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1408 microversion: 2.20 time: 0.832347 May 23 12:48:15.423142 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 32/58] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:14 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1408 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:15.498189 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-cccf9f6c-fbc5-417d-b776-794506c4767a tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:15.509766 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-cccf9f6c-fbc5-417d-b776-794506c4767a tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1502 microversion: 2.1 time: 0.339048 May 23 12:48:15.510479 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 27/59] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:15 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1502 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:15.630476 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-ee4cef20-5007-4567-b35f-ea11fee6e168 req-0e0f2b2b-22c1-4f9d-ae12-06eab429179f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6eb03bd-ab37-4dff-9646-6e6213c07618", "tag": "6a3f6cae-6d76-40b6-9182-dbb64b47f665"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:15.640656 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-ee4cef20-5007-4567-b35f-ea11fee6e168 req-0e0f2b2b-22c1-4f9d-ae12-06eab429179f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:15.641011 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-ee4cef20-5007-4567-b35f-ea11fee6e168 req-0e0f2b2b-22c1-4f9d-ae12-06eab429179f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:15.672208 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-ee4cef20-5007-4567-b35f-ea11fee6e168 req-0e0f2b2b-22c1-4f9d-ae12-06eab429179f service nova] Creating event network-changed:6a3f6cae-6d76-40b6-9182-dbb64b47f665 for instance d6eb03bd-ab37-4dff-9646-6e6213c07618 on hv-cinder-maste May 23 12:48:15.684036 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-ee4cef20-5007-4567-b35f-ea11fee6e168 req-0e0f2b2b-22c1-4f9d-ae12-06eab429179f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246312 May 23 12:48:15.684758 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 33/60] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:15.941006 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e0a437bf-cbb1-4aba-8dc7-63bc6199662a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:15.942613 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e0a437bf-cbb1-4aba-8dc7-63bc6199662a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:15.971091 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e0a437bf-cbb1-4aba-8dc7-63bc6199662a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:15.972322 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e0a437bf-cbb1-4aba-8dc7-63bc6199662a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:15.976045 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e0a437bf-cbb1-4aba-8dc7-63bc6199662a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:15.982265 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e0a437bf-cbb1-4aba-8dc7-63bc6199662a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:16.242297 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=8 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:16.371917 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e0a437bf-cbb1-4aba-8dc7-63bc6199662a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:16.384183 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e0a437bf-cbb1-4aba-8dc7-63bc6199662a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1365 microversion: 2.1 time: 0.449946 May 23 12:48:16.388814 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 28/61] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:15 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1365 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:16.442221 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5e1d6875-3a42-48ff-9956-85583a9ff1a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:16.443243 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5e1d6875-3a42-48ff-9956-85583a9ff1a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:16.451268 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5e1d6875-3a42-48ff-9956-85583a9ff1a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:16.452413 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5e1d6875-3a42-48ff-9956-85583a9ff1a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:16.453545 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5e1d6875-3a42-48ff-9956-85583a9ff1a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:16.454405 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5e1d6875-3a42-48ff-9956-85583a9ff1a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:16.707455 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5e1d6875-3a42-48ff-9956-85583a9ff1a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:16.719397 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5e1d6875-3a42-48ff-9956-85583a9ff1a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:16.723804 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5e1d6875-3a42-48ff-9956-85583a9ff1a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:16.725316 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5e1d6875-3a42-48ff-9956-85583a9ff1a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1408 microversion: 2.20 time: 0.288403 May 23 12:48:16.726219 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 34/62] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:16 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:17.170541 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1bd1e234-86ae-410c-9b6c-604b4d431296 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d8f2e8e-7441-43a0-8889-c4f1756ec15a"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:17.172005 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1bd1e234-86ae-410c-9b6c-604b4d431296 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:17.185941 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1bd1e234-86ae-410c-9b6c-604b4d431296 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:17.186358 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1bd1e234-86ae-410c-9b6c-604b4d431296 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:17.187135 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1bd1e234-86ae-410c-9b6c-604b4d431296 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:17.187560 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1bd1e234-86ae-410c-9b6c-604b4d431296 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:17.413398 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-43c5b185-c94a-46a8-b30a-95be53de5e2d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:17.414405 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-43c5b185-c94a-46a8-b30a-95be53de5e2d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:17.432589 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-43c5b185-c94a-46a8-b30a-95be53de5e2d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:17.433563 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-43c5b185-c94a-46a8-b30a-95be53de5e2d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:17.436819 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-43c5b185-c94a-46a8-b30a-95be53de5e2d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:17.438403 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-43c5b185-c94a-46a8-b30a-95be53de5e2d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:17.520808 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=2 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:17.649315 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-43c5b185-c94a-46a8-b30a-95be53de5e2d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:17.657892 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-43c5b185-c94a-46a8-b30a-95be53de5e2d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1365 microversion: 2.1 time: 0.248851 May 23 12:48:17.661808 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 35/63] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:17 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:48:17.732065 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1bd1e234-86ae-410c-9b6c-604b4d431296 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "POST /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564394 May 23 12:48:17.746132 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-50b3f805-d92f-447e-b3c5-05960a07ebd5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:17.747026 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-50b3f805-d92f-447e-b3c5-05960a07ebd5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:17.753092 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 29/64] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:48:17 2022] POST /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1/os-volume_attachments => generated 194 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:17.764593 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50b3f805-d92f-447e-b3c5-05960a07ebd5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:17.765802 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50b3f805-d92f-447e-b3c5-05960a07ebd5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:17.767773 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50b3f805-d92f-447e-b3c5-05960a07ebd5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:17.768361 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50b3f805-d92f-447e-b3c5-05960a07ebd5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:17.996877 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=16 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:18.032241 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-50b3f805-d92f-447e-b3c5-05960a07ebd5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:18.044481 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-50b3f805-d92f-447e-b3c5-05960a07ebd5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:18.046067 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-50b3f805-d92f-447e-b3c5-05960a07ebd5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:18.051403 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-50b3f805-d92f-447e-b3c5-05960a07ebd5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1408 microversion: 2.20 time: 0.310642 May 23 12:48:18.066853 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 36/65] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:17 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:18.686128 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a12beafa-be29-406c-a2b0-4c7e5a1290a9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:18.690226 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a12beafa-be29-406c-a2b0-4c7e5a1290a9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:18.704157 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a12beafa-be29-406c-a2b0-4c7e5a1290a9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:18.704885 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a12beafa-be29-406c-a2b0-4c7e5a1290a9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:18.705906 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a12beafa-be29-406c-a2b0-4c7e5a1290a9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:18.706609 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a12beafa-be29-406c-a2b0-4c7e5a1290a9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:18.906313 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a12beafa-be29-406c-a2b0-4c7e5a1290a9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:18.914416 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a12beafa-be29-406c-a2b0-4c7e5a1290a9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1365 microversion: 2.1 time: 0.239472 May 23 12:48:18.924314 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 30/66] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:18 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:19.095733 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-fdb81b8f-0f93-4fc0-8b30-dc650e534e93 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:19.097641 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-fdb81b8f-0f93-4fc0-8b30-dc650e534e93 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:19.114551 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fdb81b8f-0f93-4fc0-8b30-dc650e534e93 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:19.115177 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fdb81b8f-0f93-4fc0-8b30-dc650e534e93 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:19.118638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fdb81b8f-0f93-4fc0-8b30-dc650e534e93 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:19.120778 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fdb81b8f-0f93-4fc0-8b30-dc650e534e93 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:19.541907 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fdb81b8f-0f93-4fc0-8b30-dc650e534e93 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:19.557515 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fdb81b8f-0f93-4fc0-8b30-dc650e534e93 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:19.564744 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fdb81b8f-0f93-4fc0-8b30-dc650e534e93 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:19.571432 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-8eca2ec5-e314-4467-ae46-37a80670abcb req-338181b9-ae19-4358-946b-7643e4f841ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c365608-41a1-4663-b5e2-3481874a2325", "name": "network-vif-plugged", "status": "completed", "tag": "fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:19.572104 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-fdb81b8f-0f93-4fc0-8b30-dc650e534e93 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1408 microversion: 2.20 time: 0.487145 May 23 12:48:19.573994 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 37/67] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:19 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1408 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:19.596398 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-8eca2ec5-e314-4467-ae46-37a80670abcb req-338181b9-ae19-4358-946b-7643e4f841ae service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:19.598042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-8eca2ec5-e314-4467-ae46-37a80670abcb req-338181b9-ae19-4358-946b-7643e4f841ae service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:19.648251 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-8eca2ec5-e314-4467-ae46-37a80670abcb req-338181b9-ae19-4358-946b-7643e4f841ae service nova] Creating event network-vif-plugged:fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1 for instance 0c365608-41a1-4663-b5e2-3481874a2325 on hv-cinder-maste May 23 12:48:19.663349 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-8eca2ec5-e314-4467-ae46-37a80670abcb req-338181b9-ae19-4358-946b-7643e4f841ae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096410 May 23 12:48:19.667686 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 31/68] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:19.934716 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d82165ab-86ee-49ca-b22f-99059387d8be tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:19.935470 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d82165ab-86ee-49ca-b22f-99059387d8be tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:19.949519 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d82165ab-86ee-49ca-b22f-99059387d8be tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:19.950160 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d82165ab-86ee-49ca-b22f-99059387d8be tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:19.951068 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d82165ab-86ee-49ca-b22f-99059387d8be tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:19.952489 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d82165ab-86ee-49ca-b22f-99059387d8be tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:20.123833 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d82165ab-86ee-49ca-b22f-99059387d8be tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:20.136160 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d82165ab-86ee-49ca-b22f-99059387d8be tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1365 microversion: 2.1 time: 0.204316 May 23 12:48:20.137766 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 38/69] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:19 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:20.598297 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9b5c00c1-b50b-4815-b0d7-7e46482dcf7a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:20.599977 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9b5c00c1-b50b-4815-b0d7-7e46482dcf7a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:20.611056 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-621177f9-6424-4e1c-afd9-701a42aad2e9 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:20.612048 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-621177f9-6424-4e1c-afd9-701a42aad2e9 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:20.635101 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-621177f9-6424-4e1c-afd9-701a42aad2e9 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:20.638256 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-621177f9-6424-4e1c-afd9-701a42aad2e9 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:20.641489 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-621177f9-6424-4e1c-afd9-701a42aad2e9 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:20.641901 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b5c00c1-b50b-4815-b0d7-7e46482dcf7a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:20.642679 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-621177f9-6424-4e1c-afd9-701a42aad2e9 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:20.643327 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b5c00c1-b50b-4815-b0d7-7e46482dcf7a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:20.645903 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b5c00c1-b50b-4815-b0d7-7e46482dcf7a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:20.648282 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b5c00c1-b50b-4815-b0d7-7e46482dcf7a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:20.707994 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-621177f9-6424-4e1c-afd9-701a42aad2e9 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:48:20.895371 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-621177f9-6424-4e1c-afd9-701a42aad2e9 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 204 len: 0 microversion: 2.1 time: 0.286829 May 23 12:48:20.897453 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 39/70] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:48:20 2022] DELETE /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 12:48:20.913579 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a8c65055-7b20-416c-a466-440eb11c1b00 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:20.914829 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a8c65055-7b20-416c-a466-440eb11c1b00 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:20.915652 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9b5c00c1-b50b-4815-b0d7-7e46482dcf7a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:20.925553 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9b5c00c1-b50b-4815-b0d7-7e46482dcf7a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:20.929939 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9b5c00c1-b50b-4815-b0d7-7e46482dcf7a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:20.930713 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9b5c00c1-b50b-4815-b0d7-7e46482dcf7a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1408 microversion: 2.20 time: 0.339189 May 23 12:48:20.931280 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 32/71] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:20 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:20.938069 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a8c65055-7b20-416c-a466-440eb11c1b00 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:20.939460 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a8c65055-7b20-416c-a466-440eb11c1b00 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:20.940912 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a8c65055-7b20-416c-a466-440eb11c1b00 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:20.943226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a8c65055-7b20-416c-a466-440eb11c1b00 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:21.156592 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-42324efc-21a2-48fe-8eb0-ed8f2b6e51ca tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:21.157658 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-42324efc-21a2-48fe-8eb0-ed8f2b6e51ca tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:21.160587 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=4 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:21.175520 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-42324efc-21a2-48fe-8eb0-ed8f2b6e51ca tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:21.177551 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-42324efc-21a2-48fe-8eb0-ed8f2b6e51ca tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:21.178528 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-42324efc-21a2-48fe-8eb0-ed8f2b6e51ca tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:21.178967 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-42324efc-21a2-48fe-8eb0-ed8f2b6e51ca tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:21.257857 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a8c65055-7b20-416c-a466-440eb11c1b00 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:21.264591 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:21.272175 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a8c65055-7b20-416c-a466-440eb11c1b00 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1554 microversion: 2.1 time: 0.368868 May 23 12:48:21.275217 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 40/72] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:20 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1554 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:21.430754 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-42324efc-21a2-48fe-8eb0-ed8f2b6e51ca tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:21.439070 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-42324efc-21a2-48fe-8eb0-ed8f2b6e51ca tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1365 microversion: 2.1 time: 0.287475 May 23 12:48:21.439844 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 33/73] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:21 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:48:21.718491 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-1e51512f-0657-48fe-9f64-d2c169fd0550 req-7414815d-3d7b-40cc-ac97-c588cf1b8082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6eb03bd-ab37-4dff-9646-6e6213c07618", "name": "network-vif-plugged", "status": "completed", "tag": "6a3f6cae-6d76-40b6-9182-dbb64b47f665"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:21.731969 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-1e51512f-0657-48fe-9f64-d2c169fd0550 req-7414815d-3d7b-40cc-ac97-c588cf1b8082 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:21.733635 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-1e51512f-0657-48fe-9f64-d2c169fd0550 req-7414815d-3d7b-40cc-ac97-c588cf1b8082 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:21.750603 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-1e51512f-0657-48fe-9f64-d2c169fd0550 req-7414815d-3d7b-40cc-ac97-c588cf1b8082 service nova] Creating event network-vif-plugged:6a3f6cae-6d76-40b6-9182-dbb64b47f665 for instance d6eb03bd-ab37-4dff-9646-6e6213c07618 on hv-cinder-maste May 23 12:48:21.759608 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-1e51512f-0657-48fe-9f64-d2c169fd0550 req-7414815d-3d7b-40cc-ac97-c588cf1b8082 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049699 May 23 12:48:21.761820 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 41/74] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:21.948739 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0aa533f9-d03c-46e9-a3bf-1d35b24ce0da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:21.949437 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0aa533f9-d03c-46e9-a3bf-1d35b24ce0da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:21.965798 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0aa533f9-d03c-46e9-a3bf-1d35b24ce0da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:21.966251 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0aa533f9-d03c-46e9-a3bf-1d35b24ce0da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:21.970503 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0aa533f9-d03c-46e9-a3bf-1d35b24ce0da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:21.971370 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0aa533f9-d03c-46e9-a3bf-1d35b24ce0da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:22.190068 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0aa533f9-d03c-46e9-a3bf-1d35b24ce0da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:22.217811 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0aa533f9-d03c-46e9-a3bf-1d35b24ce0da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:22.219924 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0aa533f9-d03c-46e9-a3bf-1d35b24ce0da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:22.221867 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0aa533f9-d03c-46e9-a3bf-1d35b24ce0da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1408 microversion: 2.20 time: 0.276728 May 23 12:48:22.223057 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 34/75] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:21 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:22.293411 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-dced3298-3a98-4319-910a-6187088dab23 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:22.293411 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-dced3298-3a98-4319-910a-6187088dab23 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:22.308840 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dced3298-3a98-4319-910a-6187088dab23 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:22.310725 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dced3298-3a98-4319-910a-6187088dab23 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:22.311550 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dced3298-3a98-4319-910a-6187088dab23 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:22.311996 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dced3298-3a98-4319-910a-6187088dab23 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:22.456118 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9b5de290-24c8-4851-8c49-b0f27f8068ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:22.456720 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9b5de290-24c8-4851-8c49-b0f27f8068ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:22.464338 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b5de290-24c8-4851-8c49-b0f27f8068ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:22.464795 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b5de290-24c8-4851-8c49-b0f27f8068ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:22.471513 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b5de290-24c8-4851-8c49-b0f27f8068ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:22.471513 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b5de290-24c8-4851-8c49-b0f27f8068ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:22.556440 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-dced3298-3a98-4319-910a-6187088dab23 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:22.569514 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-dced3298-3a98-4319-910a-6187088dab23 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1554 microversion: 2.1 time: 0.283558 May 23 12:48:22.571063 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 42/76] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:22 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1554 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:22.684669 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9b5de290-24c8-4851-8c49-b0f27f8068ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:22.694696 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9b5de290-24c8-4851-8c49-b0f27f8068ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1365 microversion: 2.1 time: 0.242564 May 23 12:48:22.695854 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 35/77] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:22 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:48:23.244817 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-92288091-d269-443a-84bb-57f76c01962d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:23.245887 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-92288091-d269-443a-84bb-57f76c01962d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:23.258092 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92288091-d269-443a-84bb-57f76c01962d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:23.258857 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92288091-d269-443a-84bb-57f76c01962d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:23.259431 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92288091-d269-443a-84bb-57f76c01962d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:23.263301 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92288091-d269-443a-84bb-57f76c01962d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:23.590277 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7f30b3bb-019b-404a-82fd-d07deb1ccfbb tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:23.591998 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7f30b3bb-019b-404a-82fd-d07deb1ccfbb tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:23.616998 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f30b3bb-019b-404a-82fd-d07deb1ccfbb tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:23.617479 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f30b3bb-019b-404a-82fd-d07deb1ccfbb tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:23.618256 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f30b3bb-019b-404a-82fd-d07deb1ccfbb tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:23.618810 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f30b3bb-019b-404a-82fd-d07deb1ccfbb tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:23.650120 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:23.844287 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7f30b3bb-019b-404a-82fd-d07deb1ccfbb tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:23.855484 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-92288091-d269-443a-84bb-57f76c01962d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:23.875998 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7f30b3bb-019b-404a-82fd-d07deb1ccfbb tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1554 microversion: 2.1 time: 0.291567 May 23 12:48:23.876588 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 36/78] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:23 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1554 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:48:23.895438 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-92288091-d269-443a-84bb-57f76c01962d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:23.901775 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0d440a73-9ec8-4d99-8f78-def76ba60967 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:23.902390 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0d440a73-9ec8-4d99-8f78-def76ba60967 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:23.908136 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-92288091-d269-443a-84bb-57f76c01962d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:23.909382 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-92288091-d269-443a-84bb-57f76c01962d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1600 microversion: 2.20 time: 0.673361 May 23 12:48:23.909953 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 43/79] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:48:23 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1600 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:48:23.933339 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-29793938-9b4f-4e02-8e5b-9d39a031cdcb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:23.933907 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-29793938-9b4f-4e02-8e5b-9d39a031cdcb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:23.943048 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d440a73-9ec8-4d99-8f78-def76ba60967 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:23.943585 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d440a73-9ec8-4d99-8f78-def76ba60967 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:23.951817 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d440a73-9ec8-4d99-8f78-def76ba60967 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:23.952806 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d440a73-9ec8-4d99-8f78-def76ba60967 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:23.955415 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-29793938-9b4f-4e02-8e5b-9d39a031cdcb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:23.955844 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-29793938-9b4f-4e02-8e5b-9d39a031cdcb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:23.957775 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-29793938-9b4f-4e02-8e5b-9d39a031cdcb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:23.959998 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-29793938-9b4f-4e02-8e5b-9d39a031cdcb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:24.277936 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0d440a73-9ec8-4d99-8f78-def76ba60967 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:24.286808 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-29793938-9b4f-4e02-8e5b-9d39a031cdcb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.361313 May 23 12:48:24.287568 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 44/80] 10.222.0.45 () {60 vars in 1315 bytes} [Mon May 23 12:48:23 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-interface => generated 284 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:48:24.290811 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0d440a73-9ec8-4d99-8f78-def76ba60967 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1365 microversion: 2.1 time: 0.391706 May 23 12:48:24.295023 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 37/81] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:23 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1365 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:24.811638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-7edf17d5-2fd6-4dc6-aaa5-b1c0c60999dc req-40e4c89f-02d3-4f6d-a8ed-90842821799f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6724b3c-b905-49cb-b770-282ac7c347c1", "name": "network-vif-deleted", "tag": "61a94da0-006a-4d97-888c-e1a433cec120"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:24.823676 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-7edf17d5-2fd6-4dc6-aaa5-b1c0c60999dc req-40e4c89f-02d3-4f6d-a8ed-90842821799f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:24.824501 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-7edf17d5-2fd6-4dc6-aaa5-b1c0c60999dc req-40e4c89f-02d3-4f6d-a8ed-90842821799f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:24.858156 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-7edf17d5-2fd6-4dc6-aaa5-b1c0c60999dc req-40e4c89f-02d3-4f6d-a8ed-90842821799f service nova] Creating event network-vif-deleted:61a94da0-006a-4d97-888c-e1a433cec120 for instance d6724b3c-b905-49cb-b770-282ac7c347c1 on hv-cinder-maste May 23 12:48:24.871102 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-7edf17d5-2fd6-4dc6-aaa5-b1c0c60999dc req-40e4c89f-02d3-4f6d-a8ed-90842821799f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063438 May 23 12:48:24.872259 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 45/82] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:48:24.900671 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d0df05a3-02dd-487b-b110-e9f569bde2b5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:24.902888 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d0df05a3-02dd-487b-b110-e9f569bde2b5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:24.916545 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d0df05a3-02dd-487b-b110-e9f569bde2b5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:24.923137 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d0df05a3-02dd-487b-b110-e9f569bde2b5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:24.924271 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d0df05a3-02dd-487b-b110-e9f569bde2b5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:24.924858 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d0df05a3-02dd-487b-b110-e9f569bde2b5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:25.149549 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d0df05a3-02dd-487b-b110-e9f569bde2b5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba74f13f2a1e445dab34258d50ec8012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d4c3ce33db4711835456d22e7bfdbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:25.159006 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d0df05a3-02dd-487b-b110-e9f569bde2b5 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 200 len: 1346 microversion: 2.1 time: 0.262909 May 23 12:48:25.159810 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 38/83] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:24 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 1346 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:25.309237 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-54f0f7e7-4316-4353-98a8-e608a3f317b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:25.310431 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-54f0f7e7-4316-4353-98a8-e608a3f317b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:25.319226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-54f0f7e7-4316-4353-98a8-e608a3f317b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:25.319961 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-54f0f7e7-4316-4353-98a8-e608a3f317b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:25.322506 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-54f0f7e7-4316-4353-98a8-e608a3f317b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:25.323229 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-54f0f7e7-4316-4353-98a8-e608a3f317b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:25.723463 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-54f0f7e7-4316-4353-98a8-e608a3f317b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:25.748820 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-54f0f7e7-4316-4353-98a8-e608a3f317b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1555 microversion: 2.1 time: 0.443972 May 23 12:48:25.749431 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 46/84] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:25 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1555 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:25.772945 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-41ddb3f0-f0a9-4003-9c78-3756426fc57c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:25.773657 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-41ddb3f0-f0a9-4003-9c78-3756426fc57c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:25.798302 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-41ddb3f0-f0a9-4003-9c78-3756426fc57c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:25.800510 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-41ddb3f0-f0a9-4003-9c78-3756426fc57c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:25.804159 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-41ddb3f0-f0a9-4003-9c78-3756426fc57c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:25.804622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-41ddb3f0-f0a9-4003-9c78-3756426fc57c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:25.956888 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-41ddb3f0-f0a9-4003-9c78-3756426fc57c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189895 May 23 12:48:25.957912 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 39/85] 10.222.0.45 () {58 vars in 1274 bytes} [Mon May 23 12:48:25 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:26.177376 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-affa634e-02d4-4cf2-a781-d6e0be0537ca tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:26.177983 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-affa634e-02d4-4cf2-a781-d6e0be0537ca tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:26.188210 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-affa634e-02d4-4cf2-a781-d6e0be0537ca tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:26.196813 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-affa634e-02d4-4cf2-a781-d6e0be0537ca tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:26.201293 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-affa634e-02d4-4cf2-a781-d6e0be0537ca tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:26.206533 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-affa634e-02d4-4cf2-a781-d6e0be0537ca tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:26.257519 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-affa634e-02d4-4cf2-a781-d6e0be0537ca tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] HTTP exception thrown: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-affa634e-02d4-4cf2-a781-d6e0be0537ca tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Request method failure captured: May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 HTTP/1.1 May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4Jq1xogZQQksHKGFm998wjy4Ot_6AAJA2BYX-HZ2ijKijcpeiuffIjbjExqqv4GRuA3Ars1Fw9D6155bhKABmxgWO_-aP1J1cATqp1PaThRWlDQTtZETcMIXSHRkRKpVKPS34UdDiT9NVWzWsRiZW8zSgkNUu8ex-McGOzsCSiHj8A May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: e5d4c3ce33db4711835456d22e7bfdbb May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-DeleteServersTestJSON-147621792 May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:48:26.271738 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-DeleteServersTestJSON-147621792 May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: e5d4c3ce33db4711835456d22e7bfdbb May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-DeleteServersTestJSON-147621792 May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-DeleteServersTestJSON-147621792-project May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: ba74f13f2a1e445dab34258d50ec8012 May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-DeleteServersTestJSON-147621792-project May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:26.273209 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'd6724b3c-b905-49cb-b770-282ac7c347c1'} May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:48:26.274059 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:26.275329 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:48:26.277574 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-affa634e-02d4-4cf2-a781-d6e0be0537ca tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Returning 404 to user: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:48:26.277574 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-affa634e-02d4-4cf2-a781-d6e0be0537ca tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 404 len: 111 microversion: 2.1 time: 0.102322 May 23 12:48:26.294459 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 47/86] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:26 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:48:26.505668 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5bb67023-7363-42ad-8664-1436b2d9428e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:26.506867 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5bb67023-7363-42ad-8664-1436b2d9428e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:26.522168 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5bb67023-7363-42ad-8664-1436b2d9428e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:26.522685 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5bb67023-7363-42ad-8664-1436b2d9428e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:26.523493 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5bb67023-7363-42ad-8664-1436b2d9428e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:26.525395 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5bb67023-7363-42ad-8664-1436b2d9428e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:26.562919 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-5bb67023-7363-42ad-8664-1436b2d9428e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] HTTP exception thrown: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5bb67023-7363-42ad-8664-1436b2d9428e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Request method failure captured: May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1/os-volume_attachments HTTP/1.1 May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4Jq1xogZQQksHKGFm998wjy4Ot_6AAJA2BYX-HZ2ijKijcpeiuffIjbjExqqv4GRuA3Ars1Fw9D6155bhKABmxgWO_-aP1J1cATqp1PaThRWlDQTtZETcMIXSHRkRKpVKPS34UdDiT9NVWzWsRiZW8zSgkNUu8ex-McGOzsCSiHj8A May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: e5d4c3ce33db4711835456d22e7bfdbb May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-DeleteServersTestJSON-147621792 May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:48:26.574709 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-DeleteServersTestJSON-147621792 May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: e5d4c3ce33db4711835456d22e7bfdbb May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-DeleteServersTestJSON-147621792 May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-DeleteServersTestJSON-147621792-project May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: ba74f13f2a1e445dab34258d50ec8012 May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-DeleteServersTestJSON-147621792-project May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:26.576211 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'server_id': 'd6724b3c-b905-49cb-b770-282ac7c347c1'} May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:48:26.577046 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:26.578422 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:48:26.580826 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5bb67023-7363-42ad-8664-1436b2d9428e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Returning 404 to user: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:48:26.582285 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5bb67023-7363-42ad-8664-1436b2d9428e tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.081566 May 23 12:48:26.589475 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 40/87] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:48:26 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1/os-volume_attachments => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:48:26.996375 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-d812fda7-79f9-4694-b75b-cc268146820c req-5691111b-61c9-45df-bb49-8f703cd130c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c365608-41a1-4663-b5e2-3481874a2325", "tag": "fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:27.010078 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-d812fda7-79f9-4694-b75b-cc268146820c req-5691111b-61c9-45df-bb49-8f703cd130c1 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:27.011338 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-d812fda7-79f9-4694-b75b-cc268146820c req-5691111b-61c9-45df-bb49-8f703cd130c1 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:27.025513 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-d812fda7-79f9-4694-b75b-cc268146820c req-5691111b-61c9-45df-bb49-8f703cd130c1 service nova] Creating event network-changed:fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1 for instance 0c365608-41a1-4663-b5e2-3481874a2325 on hv-cinder-maste May 23 12:48:27.037386 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-d812fda7-79f9-4694-b75b-cc268146820c req-5691111b-61c9-45df-bb49-8f703cd130c1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045841 May 23 12:48:27.044808 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 48/88] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:27.923669 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9b6841f2-0c48-49f4-83c5-0fc89a19a040 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:27.924285 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9b6841f2-0c48-49f4-83c5-0fc89a19a040 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:27.936756 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b6841f2-0c48-49f4-83c5-0fc89a19a040 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:27.937233 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b6841f2-0c48-49f4-83c5-0fc89a19a040 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:27.938018 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b6841f2-0c48-49f4-83c5-0fc89a19a040 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:27.938455 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b6841f2-0c48-49f4-83c5-0fc89a19a040 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:27.966188 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-9b6841f2-0c48-49f4-83c5-0fc89a19a040 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] HTTP exception thrown: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9b6841f2-0c48-49f4-83c5-0fc89a19a040 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Request method failure captured: May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: DELETE /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 HTTP/1.1 May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4Jq1xogZQQksHKGFm998wjy4Ot_6AAJA2BYX-HZ2ijKijcpeiuffIjbjExqqv4GRuA3Ars1Fw9D6155bhKABmxgWO_-aP1J1cATqp1PaThRWlDQTtZETcMIXSHRkRKpVKPS34UdDiT9NVWzWsRiZW8zSgkNUu8ex-McGOzsCSiHj8A May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: e5d4c3ce33db4711835456d22e7bfdbb May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-DeleteServersTestJSON-147621792 May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:48:27.969116 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-DeleteServersTestJSON-147621792 May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: e5d4c3ce33db4711835456d22e7bfdbb May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-DeleteServersTestJSON-147621792 May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-DeleteServersTestJSON-147621792-project May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: ba74f13f2a1e445dab34258d50ec8012 May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-DeleteServersTestJSON-147621792-project May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:27.970298 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': 'd6724b3c-b905-49cb-b770-282ac7c347c1'} May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:48:27.970960 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:27.971962 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:48:27.974731 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9b6841f2-0c48-49f4-83c5-0fc89a19a040 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Returning 404 to user: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:48:27.975799 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9b6841f2-0c48-49f4-83c5-0fc89a19a040 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 404 len: 111 microversion: 2.1 time: 0.056251 May 23 12:48:27.976451 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 41/89] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:48:27 2022] DELETE /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:48:27.986891 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9558b7fd-7999-46ef-b01d-dcd9c6264dc3 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:27.988568 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-9558b7fd-7999-46ef-b01d-dcd9c6264dc3 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] [instance: d6724b3c-b905-49cb-b770-282ac7c347c1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:28.006394 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9558b7fd-7999-46ef-b01d-dcd9c6264dc3 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:28.011724 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9558b7fd-7999-46ef-b01d-dcd9c6264dc3 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:28.012881 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9558b7fd-7999-46ef-b01d-dcd9c6264dc3 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:28.016079 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9558b7fd-7999-46ef-b01d-dcd9c6264dc3 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:28.047417 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-9558b7fd-7999-46ef-b01d-dcd9c6264dc3 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] HTTP exception thrown: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9558b7fd-7999-46ef-b01d-dcd9c6264dc3 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Request method failure captured: May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 HTTP/1.1 May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4Jq1xogZQQksHKGFm998wjy4Ot_6AAJA2BYX-HZ2ijKijcpeiuffIjbjExqqv4GRuA3Ars1Fw9D6155bhKABmxgWO_-aP1J1cATqp1PaThRWlDQTtZETcMIXSHRkRKpVKPS34UdDiT9NVWzWsRiZW8zSgkNUu8ex-McGOzsCSiHj8A May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: e5d4c3ce33db4711835456d22e7bfdbb May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-DeleteServersTestJSON-147621792 May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:48:28.049698 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e5d4c3ce33db4711835456d22e7bfdbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-DeleteServersTestJSON-147621792 May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: e5d4c3ce33db4711835456d22e7bfdbb May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-DeleteServersTestJSON-147621792 May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-DeleteServersTestJSON-147621792-project May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: ba74f13f2a1e445dab34258d50ec8012 May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-DeleteServersTestJSON-147621792-project May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:28.051015 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'd6724b3c-b905-49cb-b770-282ac7c347c1'} May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:48:28.051765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. May 23 12:48:28.052860 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:48:28.055490 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9558b7fd-7999-46ef-b01d-dcd9c6264dc3 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] Returning 404 to user: Instance d6724b3c-b905-49cb-b770-282ac7c347c1 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:48:28.057791 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-9558b7fd-7999-46ef-b01d-dcd9c6264dc3 tempest-DeleteServersTestJSON-147621792 tempest-DeleteServersTestJSON-147621792-project] 10.222.0.45 "GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1" status: 404 len: 111 microversion: 2.1 time: 0.074944 May 23 12:48:28.059263 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 49/90] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:27 2022] GET /compute/v2.1/servers/d6724b3c-b905-49cb-b770-282ac7c347c1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:48:28.894758 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-3309a2bc-b93b-4e7f-96e4-99acf5a84887 req-19a3d13f-a82e-4bfb-a1b3-d15fee85d36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6eb03bd-ab37-4dff-9646-6e6213c07618", "tag": "6a3f6cae-6d76-40b6-9182-dbb64b47f665"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:28.913169 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-3309a2bc-b93b-4e7f-96e4-99acf5a84887 req-19a3d13f-a82e-4bfb-a1b3-d15fee85d36e service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:28.914144 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-3309a2bc-b93b-4e7f-96e4-99acf5a84887 req-19a3d13f-a82e-4bfb-a1b3-d15fee85d36e service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:28.951789 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-3309a2bc-b93b-4e7f-96e4-99acf5a84887 req-19a3d13f-a82e-4bfb-a1b3-d15fee85d36e service nova] Creating event network-changed:6a3f6cae-6d76-40b6-9182-dbb64b47f665 for instance d6eb03bd-ab37-4dff-9646-6e6213c07618 on hv-cinder-maste May 23 12:48:28.978086 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-3309a2bc-b93b-4e7f-96e4-99acf5a84887 req-19a3d13f-a82e-4bfb-a1b3-d15fee85d36e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075478 May 23 12:48:28.984277 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 42/91] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:38.499879 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:38.500693 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=33 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:38.629045 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-381267025", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:38.683565 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.network.neutron [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] validate_networks() for [('32f19cc5-3dd1-489f-a65f-d2b92995e233', None, None, None, None, None)] {{(pid=134546) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:48:39.117474 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Flavor limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:48:39.118010 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Image limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:48:39.118549 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Flavor pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:48:39.119100 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Image pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:48:39.119784 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:48:39.131699 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:39.132310 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:39.133277 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:39.133838 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:39.163925 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Getting quotas for project 3433fceb10214afcbc819edcec864651. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:48:39.169560 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Getting quotas for user e90f349f384245fb8a118be176ad6829 and project 3433fceb10214afcbc819edcec864651. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:48:39.182389 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Going to run 1 instances... {{(pid=134546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:48:39.184838 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:48:39.238751 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6944e62a-0732-4ff5-928c-b78891d3e934 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.744483 May 23 12:48:39.239772 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 50/92] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:48:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:48:39.252099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1792e549-675b-4c57-b8f8-2abf72612a9f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:39.253643 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1792e549-675b-4c57-b8f8-2abf72612a9f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:39.256657 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=47 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:39.257564 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=27 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:39.360036 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-1792e549-675b-4c57-b8f8-2abf72612a9f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:39.367136 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1792e549-675b-4c57-b8f8-2abf72612a9f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1221 microversion: 2.1 time: 0.119600 May 23 12:48:39.367710 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 43/93] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:39 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:39.651521 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-449079234", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:39.741166 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.network.neutron [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] validate_networks() for [('32f19cc5-3dd1-489f-a65f-d2b92995e233', None, None, None, None, None)] {{(pid=134546) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:48:40.473584 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Flavor limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:48:40.474016 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Image limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:48:40.474485 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Flavor pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:48:40.474889 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Image pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:48:40.475299 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:48:40.498828 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:40.498828 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:40.498828 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:40.498828 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:40.532410 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Getting quotas for project 3433fceb10214afcbc819edcec864651. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:48:40.539009 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Getting quotas for user e90f349f384245fb8a118be176ad6829 and project 3433fceb10214afcbc819edcec864651. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:48:40.553088 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Going to run 1 instances... {{(pid=134546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:48:40.555205 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:48:40.636447 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5530a7e5-400f-4da3-ab8f-ee6b9eb53d0b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.989827 May 23 12:48:40.637086 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 51/94] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:48:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:48:40.647236 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-039b2d74-a1a1-4426-aef2-5c2a8933c8a4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:40.648092 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-039b2d74-a1a1-4426-aef2-5c2a8933c8a4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:40.742972 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-039b2d74-a1a1-4426-aef2-5c2a8933c8a4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:40.754064 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-039b2d74-a1a1-4426-aef2-5c2a8933c8a4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1221 microversion: 2.1 time: 0.110943 May 23 12:48:40.756570 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 44/95] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:40 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:41.777647 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-eaa6b5d8-bf98-4d90-884a-44e713985f21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:41.779146 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-eaa6b5d8-bf98-4d90-884a-44e713985f21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:41.796351 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-eaa6b5d8-bf98-4d90-884a-44e713985f21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:41.800314 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-eaa6b5d8-bf98-4d90-884a-44e713985f21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:41.801685 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-eaa6b5d8-bf98-4d90-884a-44e713985f21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:41.803195 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-eaa6b5d8-bf98-4d90-884a-44e713985f21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:42.022735 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-eaa6b5d8-bf98-4d90-884a-44e713985f21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:42.033680 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-eaa6b5d8-bf98-4d90-884a-44e713985f21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1217 microversion: 2.1 time: 0.262996 May 23 12:48:42.047199 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 52/96] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:41 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1217 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:43.053623 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ad9b0c97-fea8-4d8f-b513-30db73cb6194 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:43.055342 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ad9b0c97-fea8-4d8f-b513-30db73cb6194 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:43.072611 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad9b0c97-fea8-4d8f-b513-30db73cb6194 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:43.074292 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad9b0c97-fea8-4d8f-b513-30db73cb6194 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:43.076212 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad9b0c97-fea8-4d8f-b513-30db73cb6194 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:43.076728 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad9b0c97-fea8-4d8f-b513-30db73cb6194 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:43.223899 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ad9b0c97-fea8-4d8f-b513-30db73cb6194 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:43.236235 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ad9b0c97-fea8-4d8f-b513-30db73cb6194 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1279 microversion: 2.1 time: 0.188183 May 23 12:48:43.239987 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 45/97] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:43 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:44.255438 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-799ed1e7-54ac-41ac-b77b-7f3b4e43dbb1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:44.256043 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-799ed1e7-54ac-41ac-b77b-7f3b4e43dbb1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:44.270858 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-799ed1e7-54ac-41ac-b77b-7f3b4e43dbb1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:44.272235 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-799ed1e7-54ac-41ac-b77b-7f3b4e43dbb1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:44.273637 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-799ed1e7-54ac-41ac-b77b-7f3b4e43dbb1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:44.274088 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-799ed1e7-54ac-41ac-b77b-7f3b4e43dbb1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:44.908265 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-799ed1e7-54ac-41ac-b77b-7f3b4e43dbb1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:44.947001 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-799ed1e7-54ac-41ac-b77b-7f3b4e43dbb1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1321 microversion: 2.1 time: 0.683147 May 23 12:48:44.949717 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 53/98] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:44 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1321 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:45.966440 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3e05936e-b72b-445f-8a23-2c0fcd527d18 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:45.967062 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3e05936e-b72b-445f-8a23-2c0fcd527d18 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:45.979837 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3e05936e-b72b-445f-8a23-2c0fcd527d18 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:45.980508 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3e05936e-b72b-445f-8a23-2c0fcd527d18 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:45.984568 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3e05936e-b72b-445f-8a23-2c0fcd527d18 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:45.985106 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3e05936e-b72b-445f-8a23-2c0fcd527d18 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:46.020940 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-3c0efe48-e155-41ee-aeec-836780a2c228 req-764102af-ae12-4e26-97a0-ba0aa4b7391b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73837a44-cd22-4db0-a18c-ecd5f3ec8156", "tag": "a72b2e37-3743-49cb-8581-59f03ab19b54"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:46.048436 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-3c0efe48-e155-41ee-aeec-836780a2c228 req-764102af-ae12-4e26-97a0-ba0aa4b7391b service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:46.052153 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-3c0efe48-e155-41ee-aeec-836780a2c228 req-764102af-ae12-4e26-97a0-ba0aa4b7391b service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:46.074500 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-3c0efe48-e155-41ee-aeec-836780a2c228 req-764102af-ae12-4e26-97a0-ba0aa4b7391b service nova] Creating event network-changed:a72b2e37-3743-49cb-8581-59f03ab19b54 for instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 on hv-cinder-maste May 23 12:48:46.080392 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-3c0efe48-e155-41ee-aeec-836780a2c228 req-764102af-ae12-4e26-97a0-ba0aa4b7391b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065306 May 23 12:48:46.081791 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 54/99] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:48:46.475162 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3e05936e-b72b-445f-8a23-2c0fcd527d18 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:46.487700 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3e05936e-b72b-445f-8a23-2c0fcd527d18 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1321 microversion: 2.1 time: 0.526172 May 23 12:48:46.499498 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 46/100] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:45 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:46.554439 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-3b68543d-f13e-4c09-8331-4efa6dad36ec req-b0cf6394-c22e-4df3-ab29-c804a966049c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a51cec-6c49-4f03-bd8a-f6bcd0e26f79", "tag": "4a10c41a-72fd-465c-aa34-9ebd19cc9243"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:46.579819 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-3b68543d-f13e-4c09-8331-4efa6dad36ec req-b0cf6394-c22e-4df3-ab29-c804a966049c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:46.581122 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-3b68543d-f13e-4c09-8331-4efa6dad36ec req-b0cf6394-c22e-4df3-ab29-c804a966049c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:46.624639 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-3b68543d-f13e-4c09-8331-4efa6dad36ec req-b0cf6394-c22e-4df3-ab29-c804a966049c service nova] Creating event network-changed:4a10c41a-72fd-465c-aa34-9ebd19cc9243 for instance 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 on hv-cinder-maste May 23 12:48:46.635724 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-3b68543d-f13e-4c09-8331-4efa6dad36ec req-b0cf6394-c22e-4df3-ab29-c804a966049c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086438 May 23 12:48:46.639821 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 55/101] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:47.505786 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-dea30076-79a3-44da-b29a-ef5f9567fe57 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:47.507087 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-dea30076-79a3-44da-b29a-ef5f9567fe57 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:47.523611 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dea30076-79a3-44da-b29a-ef5f9567fe57 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:47.524258 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dea30076-79a3-44da-b29a-ef5f9567fe57 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:47.525776 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dea30076-79a3-44da-b29a-ef5f9567fe57 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:47.526692 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dea30076-79a3-44da-b29a-ef5f9567fe57 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:47.716898 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-dea30076-79a3-44da-b29a-ef5f9567fe57 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:47.725125 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-dea30076-79a3-44da-b29a-ef5f9567fe57 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1321 microversion: 2.1 time: 0.223232 May 23 12:48:47.725710 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 47/102] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:47 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:48.746117 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e0fec8fa-6eaa-4536-95e3-19d323d18e96 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:48.746911 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e0fec8fa-6eaa-4536-95e3-19d323d18e96 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:48.755275 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e0fec8fa-6eaa-4536-95e3-19d323d18e96 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:48.755647 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e0fec8fa-6eaa-4536-95e3-19d323d18e96 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:48.756413 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e0fec8fa-6eaa-4536-95e3-19d323d18e96 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:48.756839 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e0fec8fa-6eaa-4536-95e3-19d323d18e96 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:48.904574 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e0fec8fa-6eaa-4536-95e3-19d323d18e96 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:48.913923 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e0fec8fa-6eaa-4536-95e3-19d323d18e96 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1321 microversion: 2.1 time: 0.172780 May 23 12:48:48.914841 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 56/103] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:48 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:48:49.933134 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-19de8321-0401-44dc-a15f-e0da387a0f66 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:49.933828 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-19de8321-0401-44dc-a15f-e0da387a0f66 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:49.946879 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-19de8321-0401-44dc-a15f-e0da387a0f66 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:49.951081 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-19de8321-0401-44dc-a15f-e0da387a0f66 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:49.951969 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-19de8321-0401-44dc-a15f-e0da387a0f66 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:49.952423 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-19de8321-0401-44dc-a15f-e0da387a0f66 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:50.204747 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-19de8321-0401-44dc-a15f-e0da387a0f66 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:50.216073 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-19de8321-0401-44dc-a15f-e0da387a0f66 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1321 microversion: 2.1 time: 0.287325 May 23 12:48:50.227691 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 48/104] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:49 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:51.240686 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ad3b2420-5ea5-4c7f-8163-3a5cdb5c3fdf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:51.242161 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ad3b2420-5ea5-4c7f-8163-3a5cdb5c3fdf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:51.255091 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=4 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:51.256970 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=12 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:51.267180 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ad3b2420-5ea5-4c7f-8163-3a5cdb5c3fdf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:51.268143 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ad3b2420-5ea5-4c7f-8163-3a5cdb5c3fdf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:51.271313 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ad3b2420-5ea5-4c7f-8163-3a5cdb5c3fdf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:51.272627 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ad3b2420-5ea5-4c7f-8163-3a5cdb5c3fdf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:51.706782 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ad3b2420-5ea5-4c7f-8163-3a5cdb5c3fdf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:51.719777 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ad3b2420-5ea5-4c7f-8163-3a5cdb5c3fdf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1321 microversion: 2.1 time: 0.486874 May 23 12:48:51.720988 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 57/105] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:51 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:52.738921 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b63a592d-9ed0-4907-a2c9-7f95a69a9d53 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:52.739975 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b63a592d-9ed0-4907-a2c9-7f95a69a9d53 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:52.752070 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=4 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:48:52.755521 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b63a592d-9ed0-4907-a2c9-7f95a69a9d53 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:52.756354 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b63a592d-9ed0-4907-a2c9-7f95a69a9d53 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:52.757641 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b63a592d-9ed0-4907-a2c9-7f95a69a9d53 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:52.758427 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b63a592d-9ed0-4907-a2c9-7f95a69a9d53 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:52.934030 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b63a592d-9ed0-4907-a2c9-7f95a69a9d53 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:52.942004 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b63a592d-9ed0-4907-a2c9-7f95a69a9d53 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1321 microversion: 2.1 time: 0.207846 May 23 12:48:52.942588 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 49/106] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:52 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:53.842361 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-d17ceff7-3cdd-4f6c-a6cd-0c72501ef598 req-7872b52f-cda8-44ef-a05c-88b2fde5b9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73837a44-cd22-4db0-a18c-ecd5f3ec8156", "name": "network-vif-plugged", "status": "completed", "tag": "a72b2e37-3743-49cb-8581-59f03ab19b54"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:53.857321 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-d17ceff7-3cdd-4f6c-a6cd-0c72501ef598 req-7872b52f-cda8-44ef-a05c-88b2fde5b9ac service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:53.857765 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-d17ceff7-3cdd-4f6c-a6cd-0c72501ef598 req-7872b52f-cda8-44ef-a05c-88b2fde5b9ac service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:53.888377 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-d17ceff7-3cdd-4f6c-a6cd-0c72501ef598 req-7872b52f-cda8-44ef-a05c-88b2fde5b9ac service nova] Creating event network-vif-plugged:a72b2e37-3743-49cb-8581-59f03ab19b54 for instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 on hv-cinder-maste May 23 12:48:53.894773 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-d17ceff7-3cdd-4f6c-a6cd-0c72501ef598 req-7872b52f-cda8-44ef-a05c-88b2fde5b9ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058084 May 23 12:48:53.896089 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 58/107] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:53.966038 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6d2e0c8a-7503-486e-84cf-18362afca69f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:53.966645 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6d2e0c8a-7503-486e-84cf-18362afca69f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:53.984634 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d2e0c8a-7503-486e-84cf-18362afca69f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:53.985084 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d2e0c8a-7503-486e-84cf-18362afca69f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:53.985884 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d2e0c8a-7503-486e-84cf-18362afca69f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:53.987304 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d2e0c8a-7503-486e-84cf-18362afca69f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:54.213194 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6d2e0c8a-7503-486e-84cf-18362afca69f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:54.222372 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6d2e0c8a-7503-486e-84cf-18362afca69f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1321 microversion: 2.1 time: 0.266911 May 23 12:48:54.223603 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 50/108] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:53 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:55.240909 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e2c0f3ed-8672-43f8-9bc0-67958b35bda0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:55.241841 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e2c0f3ed-8672-43f8-9bc0-67958b35bda0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:55.249378 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2c0f3ed-8672-43f8-9bc0-67958b35bda0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:55.249830 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2c0f3ed-8672-43f8-9bc0-67958b35bda0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:55.250749 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2c0f3ed-8672-43f8-9bc0-67958b35bda0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:55.250866 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-739364739", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "networks": [{"uuid": "d515d466-4f2f-4766-a2f0-28a8a04bb615"}]}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:55.251306 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2c0f3ed-8672-43f8-9bc0-67958b35bda0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:55.317526 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.network.neutron [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] validate_networks() for [('d515d466-4f2f-4766-a2f0-28a8a04bb615', None, None, None, None, None)] {{(pid=134546) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:48:55.427513 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e2c0f3ed-8672-43f8-9bc0-67958b35bda0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:55.438557 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e2c0f3ed-8672-43f8-9bc0-67958b35bda0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1321 microversion: 2.1 time: 0.201986 May 23 12:48:55.439965 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 51/109] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:55 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:55.725921 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Flavor limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:48:55.726935 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Image limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:48:55.727451 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Flavor pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:48:55.728639 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Image pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:48:55.729691 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:48:55.740217 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:55.740660 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:55.741486 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:55.741921 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:55.759682 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Getting quotas for project cbfd0d4dd49c464bab39efeb0a87991d. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:48:55.763880 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Getting quotas for user f1877c8dc1af45d3b4015950f8e51718 and project cbfd0d4dd49c464bab39efeb0a87991d. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:48:55.776606 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Going to run 1 instances... {{(pid=134546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:48:55.779023 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:48:55.831002 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a07f07a5-02f6-47af-83f3-7ae25a67b348 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704718 May 23 12:48:55.831818 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 59/110] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:48:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:48:55.842375 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-bd329f06-8515-4ef5-af89-9d3ee37da491 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:55.843410 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-bd329f06-8515-4ef5-af89-9d3ee37da491 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:55.925081 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-77868034-2ec0-4f41-8abc-489d812d7f6b req-95548b69-f635-4561-b7e9-9cb18826b10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a51cec-6c49-4f03-bd8a-f6bcd0e26f79", "name": "network-vif-plugged", "status": "completed", "tag": "4a10c41a-72fd-465c-aa34-9ebd19cc9243"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:55.927202 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-bd329f06-8515-4ef5-af89-9d3ee37da491 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:55.935048 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-bd329f06-8515-4ef5-af89-9d3ee37da491 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1213 microversion: 2.1 time: 0.097011 May 23 12:48:55.935955 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 52/111] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:55 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:55.942442 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-77868034-2ec0-4f41-8abc-489d812d7f6b req-95548b69-f635-4561-b7e9-9cb18826b10f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:55.943214 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-77868034-2ec0-4f41-8abc-489d812d7f6b req-95548b69-f635-4561-b7e9-9cb18826b10f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:55.954734 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-77868034-2ec0-4f41-8abc-489d812d7f6b req-95548b69-f635-4561-b7e9-9cb18826b10f service nova] Creating event network-vif-plugged:4a10c41a-72fd-465c-aa34-9ebd19cc9243 for instance 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 on hv-cinder-maste May 23 12:48:55.959807 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-77868034-2ec0-4f41-8abc-489d812d7f6b req-95548b69-f635-4561-b7e9-9cb18826b10f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038153 May 23 12:48:55.960583 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 60/112] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:48:56.458189 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1b614c2c-6446-4ea2-8fee-2206c5fe8944 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:56.458189 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1b614c2c-6446-4ea2-8fee-2206c5fe8944 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:56.476498 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1b614c2c-6446-4ea2-8fee-2206c5fe8944 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:56.476938 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1b614c2c-6446-4ea2-8fee-2206c5fe8944 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:56.478524 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1b614c2c-6446-4ea2-8fee-2206c5fe8944 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:56.479423 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1b614c2c-6446-4ea2-8fee-2206c5fe8944 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:56.664308 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-1b614c2c-6446-4ea2-8fee-2206c5fe8944 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:56.676504 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1b614c2c-6446-4ea2-8fee-2206c5fe8944 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1321 microversion: 2.1 time: 0.224476 May 23 12:48:56.678806 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 53/113] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:56 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:56.954455 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-0131d12f-2694-49e7-bdc5-72afbc65d0d5 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:56.955326 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-0131d12f-2694-49e7-bdc5-72afbc65d0d5 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:56.965662 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0131d12f-2694-49e7-bdc5-72afbc65d0d5 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:56.966530 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0131d12f-2694-49e7-bdc5-72afbc65d0d5 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:56.968327 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0131d12f-2694-49e7-bdc5-72afbc65d0d5 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:56.968763 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0131d12f-2694-49e7-bdc5-72afbc65d0d5 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:57.064495 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-0131d12f-2694-49e7-bdc5-72afbc65d0d5 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:57.074836 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-0131d12f-2694-49e7-bdc5-72afbc65d0d5 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1265 microversion: 2.1 time: 0.124771 May 23 12:48:57.075801 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 61/114] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:56 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:57.698975 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5b18e858-4473-4dec-aba6-bbe427703601 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:57.699764 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5b18e858-4473-4dec-aba6-bbe427703601 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:57.710851 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5b18e858-4473-4dec-aba6-bbe427703601 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:57.711314 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5b18e858-4473-4dec-aba6-bbe427703601 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:57.713374 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5b18e858-4473-4dec-aba6-bbe427703601 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:57.714881 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5b18e858-4473-4dec-aba6-bbe427703601 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:57.889478 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5b18e858-4473-4dec-aba6-bbe427703601 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:57.901027 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5b18e858-4473-4dec-aba6-bbe427703601 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1515 microversion: 2.1 time: 0.208386 May 23 12:48:57.902088 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 54/115] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:57 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:57.922038 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-62ac6be2-24fb-4e92-a50a-b0a786be01f4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:48:57.923440 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-62ac6be2-24fb-4e92-a50a-b0a786be01f4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:57.933740 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-62ac6be2-24fb-4e92-a50a-b0a786be01f4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:57.934983 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-62ac6be2-24fb-4e92-a50a-b0a786be01f4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:57.936012 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-62ac6be2-24fb-4e92-a50a-b0a786be01f4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:57.936687 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-62ac6be2-24fb-4e92-a50a-b0a786be01f4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:57.967801 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-62ac6be2-24fb-4e92-a50a-b0a786be01f4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lazy-loading 'flavor' on Instance uuid 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:48:58.093378 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ca69e8be-7fbf-485d-83f4-4de360f41c15 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:58.093952 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ca69e8be-7fbf-485d-83f4-4de360f41c15 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:58.111766 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca69e8be-7fbf-485d-83f4-4de360f41c15 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:58.113846 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca69e8be-7fbf-485d-83f4-4de360f41c15 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:58.115641 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca69e8be-7fbf-485d-83f4-4de360f41c15 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:58.119793 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca69e8be-7fbf-485d-83f4-4de360f41c15 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:58.193436 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-62ac6be2-24fb-4e92-a50a-b0a786be01f4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79/action" status: 200 len: 32 microversion: 2.1 time: 0.278579 May 23 12:48:58.194380 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 62/116] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:48:57 2022] POST /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79/action => generated 32 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:48:58.210444 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e1d5d400-0cad-4799-beb5-6b65b0281395 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:58.214772 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e1d5d400-0cad-4799-beb5-6b65b0281395 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:58.235431 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e1d5d400-0cad-4799-beb5-6b65b0281395 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:58.237856 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e1d5d400-0cad-4799-beb5-6b65b0281395 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:58.241133 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e1d5d400-0cad-4799-beb5-6b65b0281395 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:58.242062 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e1d5d400-0cad-4799-beb5-6b65b0281395 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:58.283691 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ca69e8be-7fbf-485d-83f4-4de360f41c15 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:58.297242 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ca69e8be-7fbf-485d-83f4-4de360f41c15 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1273 microversion: 2.1 time: 0.208364 May 23 12:48:58.310537 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 55/117] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:58 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1273 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:58.553926 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e1d5d400-0cad-4799-beb5-6b65b0281395 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:58.565218 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e1d5d400-0cad-4799-beb5-6b65b0281395 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.362494 May 23 12:48:58.568407 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 63/118] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:58 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:59.316113 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a94897d2-825e-4847-89ab-57e0d0780306 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:59.316803 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a94897d2-825e-4847-89ab-57e0d0780306 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:59.324330 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a94897d2-825e-4847-89ab-57e0d0780306 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:59.324873 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a94897d2-825e-4847-89ab-57e0d0780306 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:59.325755 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a94897d2-825e-4847-89ab-57e0d0780306 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:59.326267 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a94897d2-825e-4847-89ab-57e0d0780306 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:59.496556 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a94897d2-825e-4847-89ab-57e0d0780306 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:59.506559 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a94897d2-825e-4847-89ab-57e0d0780306 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1313 microversion: 2.1 time: 0.193099 May 23 12:48:59.506559 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 56/119] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:59 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:48:59.585391 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3a801179-f5eb-47fe-8b2e-b42fa09def73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:48:59.585999 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3a801179-f5eb-47fe-8b2e-b42fa09def73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:48:59.597562 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3a801179-f5eb-47fe-8b2e-b42fa09def73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:59.598707 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3a801179-f5eb-47fe-8b2e-b42fa09def73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:59.599478 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3a801179-f5eb-47fe-8b2e-b42fa09def73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:48:59.599905 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3a801179-f5eb-47fe-8b2e-b42fa09def73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:48:59.875589 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3a801179-f5eb-47fe-8b2e-b42fa09def73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:48:59.885611 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3a801179-f5eb-47fe-8b2e-b42fa09def73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.304171 May 23 12:48:59.886197 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 64/120] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:48:59 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:00.184739 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-5f528634-f7ca-4218-8ebc-c59ddfbd0496 req-d414b864-165f-4b0e-b9f8-d09d9132749c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222c89a4-90e9-4202-9d7d-613791d2edb3", "tag": "b4d80269-a059-46b6-b29d-262af496856a"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:00.195550 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-5f528634-f7ca-4218-8ebc-c59ddfbd0496 req-d414b864-165f-4b0e-b9f8-d09d9132749c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:00.196082 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-5f528634-f7ca-4218-8ebc-c59ddfbd0496 req-d414b864-165f-4b0e-b9f8-d09d9132749c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:00.216468 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-5f528634-f7ca-4218-8ebc-c59ddfbd0496 req-d414b864-165f-4b0e-b9f8-d09d9132749c service nova] Creating event network-changed:b4d80269-a059-46b6-b29d-262af496856a for instance 222c89a4-90e9-4202-9d7d-613791d2edb3 on hv-cinder-maste May 23 12:49:00.222644 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-5f528634-f7ca-4218-8ebc-c59ddfbd0496 req-d414b864-165f-4b0e-b9f8-d09d9132749c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042923 May 23 12:49:00.223349 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 57/121] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:00.526719 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d7bb87c9-0e65-4d3a-afa4-0d9566e359b7 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:00.527683 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d7bb87c9-0e65-4d3a-afa4-0d9566e359b7 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:00.533655 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7bb87c9-0e65-4d3a-afa4-0d9566e359b7 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:00.534309 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7bb87c9-0e65-4d3a-afa4-0d9566e359b7 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:00.535225 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7bb87c9-0e65-4d3a-afa4-0d9566e359b7 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:00.535808 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7bb87c9-0e65-4d3a-afa4-0d9566e359b7 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:00.848611 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1027783718", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:00.859880 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d7bb87c9-0e65-4d3a-afa4-0d9566e359b7 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:00.870416 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d7bb87c9-0e65-4d3a-afa4-0d9566e359b7 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1313 microversion: 2.1 time: 0.347473 May 23 12:49:00.871264 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 65/122] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:00 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:00.905805 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-aec592ef-d567-4e58-b5ec-9c57e487a731 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:00.906502 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-aec592ef-d567-4e58-b5ec-9c57e487a731 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:00.915961 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aec592ef-d567-4e58-b5ec-9c57e487a731 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:00.917354 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aec592ef-d567-4e58-b5ec-9c57e487a731 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:00.918162 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aec592ef-d567-4e58-b5ec-9c57e487a731 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:00.918661 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aec592ef-d567-4e58-b5ec-9c57e487a731 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:00.946079 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] validate_networks() for None {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:49:01.106890 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-aec592ef-d567-4e58-b5ec-9c57e487a731 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:01.116003 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-aec592ef-d567-4e58-b5ec-9c57e487a731 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.217820 May 23 12:49:01.116703 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 66/123] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:00 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:01.288978 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:49:01.289613 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:49:01.290078 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:49:01.290813 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:49:01.291407 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:49:01.300941 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:01.301412 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:01.302192 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:01.302623 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:01.320422 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Getting quotas for project 0d69183d45fe4f1baa8f71d86c1d6375. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:49:01.335853 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Getting quotas for user 2eabb186921a475b8aae82a55a3b35d5 and project 0d69183d45fe4f1baa8f71d86c1d6375. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:49:01.351971 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:49:01.354736 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:49:01.402522 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ade842fb-c996-47f8-8b0d-c797c116b3da tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561193 May 23 12:49:01.403344 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 58/124] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:49:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:49:01.414741 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2698402e-a34f-4979-b453-994dd4bc8ab0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:01.415430 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2698402e-a34f-4979-b453-994dd4bc8ab0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:01.481824 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2698402e-a34f-4979-b453-994dd4bc8ab0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:01.491319 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2698402e-a34f-4979-b453-994dd4bc8ab0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1215 microversion: 2.1 time: 0.081767 May 23 12:49:01.491902 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 67/125] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:01 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:01.889991 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-81a14d34-a033-49c4-8602-6a2e27c6cf18 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:01.889991 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-81a14d34-a033-49c4-8602-6a2e27c6cf18 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:01.895482 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-81a14d34-a033-49c4-8602-6a2e27c6cf18 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:01.895931 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-81a14d34-a033-49c4-8602-6a2e27c6cf18 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:01.896697 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-81a14d34-a033-49c4-8602-6a2e27c6cf18 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:01.897129 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-81a14d34-a033-49c4-8602-6a2e27c6cf18 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:02.134905 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9f2e2fd9-0fba-46df-9c4a-8922ff12ffc2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:02.136444 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-9f2e2fd9-0fba-46df-9c4a-8922ff12ffc2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:02.153975 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9f2e2fd9-0fba-46df-9c4a-8922ff12ffc2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:02.154421 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9f2e2fd9-0fba-46df-9c4a-8922ff12ffc2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:02.155191 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9f2e2fd9-0fba-46df-9c4a-8922ff12ffc2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:02.155618 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9f2e2fd9-0fba-46df-9c4a-8922ff12ffc2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:02.176312 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-81a14d34-a033-49c4-8602-6a2e27c6cf18 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:02.198038 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-81a14d34-a033-49c4-8602-6a2e27c6cf18 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1313 microversion: 2.1 time: 0.314556 May 23 12:49:02.198806 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 59/126] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:01 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:02.509398 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a8245e4c-432d-4872-a2ba-fab639765fd1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:02.510634 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a8245e4c-432d-4872-a2ba-fab639765fd1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:02.525997 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a8245e4c-432d-4872-a2ba-fab639765fd1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:02.526861 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a8245e4c-432d-4872-a2ba-fab639765fd1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:02.527985 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a8245e4c-432d-4872-a2ba-fab639765fd1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:02.529909 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a8245e4c-432d-4872-a2ba-fab639765fd1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:02.619549 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9f2e2fd9-0fba-46df-9c4a-8922ff12ffc2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:02.632844 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-9f2e2fd9-0fba-46df-9c4a-8922ff12ffc2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.501737 May 23 12:49:02.635252 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 68/127] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:02 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:02.680202 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a8245e4c-432d-4872-a2ba-fab639765fd1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:02.693653 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a8245e4c-432d-4872-a2ba-fab639765fd1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1267 microversion: 2.1 time: 0.188106 May 23 12:49:02.694648 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 60/128] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:02 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:03.217048 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-11618af0-83c3-4f8b-bd93-233bdba4bce2 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:03.219234 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-11618af0-83c3-4f8b-bd93-233bdba4bce2 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:03.229741 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-11618af0-83c3-4f8b-bd93-233bdba4bce2 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:03.230300 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-11618af0-83c3-4f8b-bd93-233bdba4bce2 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:03.231079 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-11618af0-83c3-4f8b-bd93-233bdba4bce2 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:03.231511 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-11618af0-83c3-4f8b-bd93-233bdba4bce2 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:03.399075 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-11618af0-83c3-4f8b-bd93-233bdba4bce2 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:03.408844 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-11618af0-83c3-4f8b-bd93-233bdba4bce2 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1313 microversion: 2.1 time: 0.197103 May 23 12:49:03.409452 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 69/129] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:03 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:03.652802 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7f3de1ee-bec5-490c-a5bd-379bb3b96941 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:03.654260 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7f3de1ee-bec5-490c-a5bd-379bb3b96941 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:03.662840 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f3de1ee-bec5-490c-a5bd-379bb3b96941 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:03.663533 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f3de1ee-bec5-490c-a5bd-379bb3b96941 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:03.664115 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f3de1ee-bec5-490c-a5bd-379bb3b96941 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:03.664745 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f3de1ee-bec5-490c-a5bd-379bb3b96941 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:03.711582 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-0cc15b6a-a5bc-4810-a01d-38111714ed5b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:03.713255 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-0cc15b6a-a5bc-4810-a01d-38111714ed5b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:03.726055 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0cc15b6a-a5bc-4810-a01d-38111714ed5b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:03.727032 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0cc15b6a-a5bc-4810-a01d-38111714ed5b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:03.729306 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0cc15b6a-a5bc-4810-a01d-38111714ed5b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:03.730796 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0cc15b6a-a5bc-4810-a01d-38111714ed5b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:03.741417 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:04.044662 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7f3de1ee-bec5-490c-a5bd-379bb3b96941 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:04.055111 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7f3de1ee-bec5-490c-a5bd-379bb3b96941 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.407191 May 23 12:49:04.058103 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 61/130] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:03 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:04.117913 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-0cc15b6a-a5bc-4810-a01d-38111714ed5b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:04.129941 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-0cc15b6a-a5bc-4810-a01d-38111714ed5b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.422738 May 23 12:49:04.153890 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 70/131] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:03 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:04.430230 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-53c03099-fdb0-478d-ae50-1185900e3aa8 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:04.431942 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-53c03099-fdb0-478d-ae50-1185900e3aa8 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:04.450086 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-53c03099-fdb0-478d-ae50-1185900e3aa8 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:04.450713 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-53c03099-fdb0-478d-ae50-1185900e3aa8 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:04.451671 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-53c03099-fdb0-478d-ae50-1185900e3aa8 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:04.452234 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-53c03099-fdb0-478d-ae50-1185900e3aa8 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:04.963554 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-53c03099-fdb0-478d-ae50-1185900e3aa8 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:04.971406 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-53c03099-fdb0-478d-ae50-1185900e3aa8 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1313 microversion: 2.1 time: 0.546475 May 23 12:49:04.972357 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 62/132] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:04 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:05.019903 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-7e997505-d60a-474b-abe0-42186a435736 req-882b9854-6a95-4c63-8d77-f83e5dabfac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3a8229-9fed-4b75-9391-782f4d06d316", "tag": "339b32e1-566b-4705-a78f-dda1a28241b8"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:05.036400 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-7e997505-d60a-474b-abe0-42186a435736 req-882b9854-6a95-4c63-8d77-f83e5dabfac5 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:05.051654 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-7e997505-d60a-474b-abe0-42186a435736 req-882b9854-6a95-4c63-8d77-f83e5dabfac5 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:05.072466 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7c5fb91c-7bd3-4227-8ba2-17e9242cfb52 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:05.073255 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7c5fb91c-7bd3-4227-8ba2-17e9242cfb52 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:05.079771 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-7e997505-d60a-474b-abe0-42186a435736 req-882b9854-6a95-4c63-8d77-f83e5dabfac5 service nova] Creating event network-changed:339b32e1-566b-4705-a78f-dda1a28241b8 for instance ba3a8229-9fed-4b75-9391-782f4d06d316 on hv-cinder-maste May 23 12:49:05.082532 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7c5fb91c-7bd3-4227-8ba2-17e9242cfb52 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:05.083101 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7c5fb91c-7bd3-4227-8ba2-17e9242cfb52 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:05.084099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7c5fb91c-7bd3-4227-8ba2-17e9242cfb52 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:05.086042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7c5fb91c-7bd3-4227-8ba2-17e9242cfb52 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:05.087631 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-7e997505-d60a-474b-abe0-42186a435736 req-882b9854-6a95-4c63-8d77-f83e5dabfac5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069845 May 23 12:49:05.088268 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 71/133] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:05.153307 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ce9a72ca-3a26-4aab-a0c7-bc45ea1e981c tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:05.154171 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ce9a72ca-3a26-4aab-a0c7-bc45ea1e981c tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:05.162510 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ce9a72ca-3a26-4aab-a0c7-bc45ea1e981c tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:05.163017 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ce9a72ca-3a26-4aab-a0c7-bc45ea1e981c tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:05.163860 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ce9a72ca-3a26-4aab-a0c7-bc45ea1e981c tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:05.164622 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ce9a72ca-3a26-4aab-a0c7-bc45ea1e981c tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:05.421207 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7c5fb91c-7bd3-4227-8ba2-17e9242cfb52 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:05.425475 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=100 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:05.434187 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7c5fb91c-7bd3-4227-8ba2-17e9242cfb52 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.366089 May 23 12:49:05.437419 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 63/134] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:05 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:05.457550 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ce9a72ca-3a26-4aab-a0c7-bc45ea1e981c tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:05.470941 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ce9a72ca-3a26-4aab-a0c7-bc45ea1e981c tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.324497 May 23 12:49:05.471576 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 72/135] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:05 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:05.927927 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-6b138ae1-46af-435c-897d-9e4df7aef9d4 req-c5bb05ad-0c33-4537-816e-1a9fdc0803e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222c89a4-90e9-4202-9d7d-613791d2edb3", "name": "network-vif-plugged", "status": "completed", "tag": "b4d80269-a059-46b6-b29d-262af496856a"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:05.937226 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-6b138ae1-46af-435c-897d-9e4df7aef9d4 req-c5bb05ad-0c33-4537-816e-1a9fdc0803e1 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:05.945041 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-6b138ae1-46af-435c-897d-9e4df7aef9d4 req-c5bb05ad-0c33-4537-816e-1a9fdc0803e1 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:05.957983 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-6b138ae1-46af-435c-897d-9e4df7aef9d4 req-c5bb05ad-0c33-4537-816e-1a9fdc0803e1 service nova] Creating event network-vif-plugged:b4d80269-a059-46b6-b29d-262af496856a for instance 222c89a4-90e9-4202-9d7d-613791d2edb3 on hv-cinder-maste May 23 12:49:05.964798 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-6b138ae1-46af-435c-897d-9e4df7aef9d4 req-c5bb05ad-0c33-4537-816e-1a9fdc0803e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040672 May 23 12:49:05.972684 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 64/136] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:06.005368 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5fbe778b-0c14-48a7-8c47-1060484952f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:06.006124 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5fbe778b-0c14-48a7-8c47-1060484952f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:06.009845 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=2 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:06.016433 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5fbe778b-0c14-48a7-8c47-1060484952f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:06.017181 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5fbe778b-0c14-48a7-8c47-1060484952f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:06.018624 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5fbe778b-0c14-48a7-8c47-1060484952f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:06.019218 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5fbe778b-0c14-48a7-8c47-1060484952f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:06.163249 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5fbe778b-0c14-48a7-8c47-1060484952f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:06.172746 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5fbe778b-0c14-48a7-8c47-1060484952f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1313 microversion: 2.1 time: 0.175480 May 23 12:49:06.173698 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 73/137] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:05 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:06.452845 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-cad29e38-5329-4557-a64e-d223696bb810 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:06.453559 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-cad29e38-5329-4557-a64e-d223696bb810 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:06.459895 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cad29e38-5329-4557-a64e-d223696bb810 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:06.460342 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cad29e38-5329-4557-a64e-d223696bb810 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:06.461694 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cad29e38-5329-4557-a64e-d223696bb810 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:06.462323 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cad29e38-5329-4557-a64e-d223696bb810 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:06.488660 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2963273a-2281-4f07-aeb9-0b14678553de tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:06.489306 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2963273a-2281-4f07-aeb9-0b14678553de tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:06.496032 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2963273a-2281-4f07-aeb9-0b14678553de tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:06.496477 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2963273a-2281-4f07-aeb9-0b14678553de tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:06.497274 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2963273a-2281-4f07-aeb9-0b14678553de tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:06.498059 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2963273a-2281-4f07-aeb9-0b14678553de tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:06.625941 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-cad29e38-5329-4557-a64e-d223696bb810 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:06.634387 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-cad29e38-5329-4557-a64e-d223696bb810 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.185107 May 23 12:49:06.635365 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 65/138] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:06 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:06.653043 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2963273a-2281-4f07-aeb9-0b14678553de tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:06.660524 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2963273a-2281-4f07-aeb9-0b14678553de tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.176758 May 23 12:49:06.661086 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 74/139] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:06 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:07.178078 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-495181211", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "networks": [{"uuid": "72babcee-0278-49cc-a015-a5316fc87017"}]}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:07.189375 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8ee5b3bc-9e90-46af-974a-6cd8fa381ff1 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:07.190605 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8ee5b3bc-9e90-46af-974a-6cd8fa381ff1 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:07.197013 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8ee5b3bc-9e90-46af-974a-6cd8fa381ff1 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:07.197440 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8ee5b3bc-9e90-46af-974a-6cd8fa381ff1 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:07.198592 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8ee5b3bc-9e90-46af-974a-6cd8fa381ff1 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:07.198753 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8ee5b3bc-9e90-46af-974a-6cd8fa381ff1 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:07.237236 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] validate_networks() for [('72babcee-0278-49cc-a015-a5316fc87017', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:49:07.388685 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8ee5b3bc-9e90-46af-974a-6cd8fa381ff1 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:07.397086 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8ee5b3bc-9e90-46af-974a-6cd8fa381ff1 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1313 microversion: 2.1 time: 0.211539 May 23 12:49:07.405899 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 75/140] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:07 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:07.651945 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d133e34f-55fe-491b-acdb-2803ebd0e95d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:07.652551 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d133e34f-55fe-491b-acdb-2803ebd0e95d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:07.658931 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d133e34f-55fe-491b-acdb-2803ebd0e95d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:07.659639 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d133e34f-55fe-491b-acdb-2803ebd0e95d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:07.660571 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d133e34f-55fe-491b-acdb-2803ebd0e95d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:07.661243 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d133e34f-55fe-491b-acdb-2803ebd0e95d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:07.733160 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:49:07.733796 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:49:07.734273 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:49:07.734787 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:49:07.735189 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:49:07.745538 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:07.745970 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:07.747142 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:07.747642 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:07.765533 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Getting quotas for project f894226ce03c4512a633fac4618d82b2. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:49:07.769601 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Getting quotas for user dfea4e573d5449e6943b8700424f556b and project f894226ce03c4512a633fac4618d82b2. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:49:07.781303 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:49:07.783686 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:49:07.813271 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d133e34f-55fe-491b-acdb-2803ebd0e95d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:07.824876 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d133e34f-55fe-491b-acdb-2803ebd0e95d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.176991 May 23 12:49:07.825651 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 76/141] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:07 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:07.830417 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ca106454-0526-4654-80bb-1643b07bbd54 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:07.831243 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ca106454-0526-4654-80bb-1643b07bbd54 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:07.836311 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:07.838104 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-cad3da71-a59c-4e5f-8ea8-b06706d11bae tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663882 May 23 12:49:07.838864 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca106454-0526-4654-80bb-1643b07bbd54 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:07.839200 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 66/142] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:49:07.839328 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca106454-0526-4654-80bb-1643b07bbd54 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:07.840165 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca106454-0526-4654-80bb-1643b07bbd54 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:07.840606 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca106454-0526-4654-80bb-1643b07bbd54 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:07.850413 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-66c1d684-7f0a-4981-a7b2-3c3336a0d86c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:07.851411 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-66c1d684-7f0a-4981-a7b2-3c3336a0d86c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:07.917560 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-66c1d684-7f0a-4981-a7b2-3c3336a0d86c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:07.926189 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-66c1d684-7f0a-4981-a7b2-3c3336a0d86c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1213 microversion: 2.1 time: 0.079691 May 23 12:49:07.927750 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 67/143] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:07 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:08.005979 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ca106454-0526-4654-80bb-1643b07bbd54 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:08.015201 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ca106454-0526-4654-80bb-1643b07bbd54 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.188293 May 23 12:49:08.019281 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 77/144] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:07 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:08.414829 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a0526478-687a-4fb8-9006-cc6e22bd33f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:08.415535 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a0526478-687a-4fb8-9006-cc6e22bd33f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:08.422411 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0526478-687a-4fb8-9006-cc6e22bd33f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:08.422862 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0526478-687a-4fb8-9006-cc6e22bd33f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:08.423618 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0526478-687a-4fb8-9006-cc6e22bd33f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:08.424050 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0526478-687a-4fb8-9006-cc6e22bd33f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:08.561660 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a0526478-687a-4fb8-9006-cc6e22bd33f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:08.569559 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a0526478-687a-4fb8-9006-cc6e22bd33f3 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1313 microversion: 2.1 time: 0.158685 May 23 12:49:08.570209 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 68/145] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:08 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:08.843395 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3c5532e7-aefd-40df-a997-79affadf62c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:08.843985 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3c5532e7-aefd-40df-a997-79affadf62c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:08.849929 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3c5532e7-aefd-40df-a997-79affadf62c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:08.850371 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3c5532e7-aefd-40df-a997-79affadf62c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:08.851123 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3c5532e7-aefd-40df-a997-79affadf62c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:08.851551 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3c5532e7-aefd-40df-a997-79affadf62c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:08.947815 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d334b381-9306-4376-a622-0a9e9ffbc2eb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:08.950603 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d334b381-9306-4376-a622-0a9e9ffbc2eb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:08.959754 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d334b381-9306-4376-a622-0a9e9ffbc2eb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:08.960335 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d334b381-9306-4376-a622-0a9e9ffbc2eb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:08.961242 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d334b381-9306-4376-a622-0a9e9ffbc2eb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:08.962486 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d334b381-9306-4376-a622-0a9e9ffbc2eb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:09.008220 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3c5532e7-aefd-40df-a997-79affadf62c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:09.017259 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3c5532e7-aefd-40df-a997-79affadf62c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.178710 May 23 12:49:09.027330 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 78/146] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:08 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:09.040370 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-bf55fe27-b118-440e-940c-562f5edc0ed1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:09.040988 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-bf55fe27-b118-440e-940c-562f5edc0ed1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:09.050190 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bf55fe27-b118-440e-940c-562f5edc0ed1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:09.050897 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bf55fe27-b118-440e-940c-562f5edc0ed1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:09.051753 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bf55fe27-b118-440e-940c-562f5edc0ed1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:09.052598 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bf55fe27-b118-440e-940c-562f5edc0ed1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:09.067497 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d334b381-9306-4376-a622-0a9e9ffbc2eb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:09.079393 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d334b381-9306-4376-a622-0a9e9ffbc2eb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1217 microversion: 2.1 time: 0.139060 May 23 12:49:09.080430 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 69/147] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:08 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:09.221995 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e4a4a026-a8e7-436f-8a7a-43c3a10c6371 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:09.222497 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e4a4a026-a8e7-436f-8a7a-43c3a10c6371 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:09.229561 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e4a4a026-a8e7-436f-8a7a-43c3a10c6371 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:09.230095 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e4a4a026-a8e7-436f-8a7a-43c3a10c6371 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:09.230929 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e4a4a026-a8e7-436f-8a7a-43c3a10c6371 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:09.231489 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e4a4a026-a8e7-436f-8a7a-43c3a10c6371 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:09.245755 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-bf55fe27-b118-440e-940c-562f5edc0ed1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:09.254566 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-bf55fe27-b118-440e-940c-562f5edc0ed1 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.225325 May 23 12:49:09.255284 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 79/148] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:09 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:09.258067 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e4a4a026-a8e7-436f-8a7a-43c3a10c6371 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/ips" status: 200 len: 151 microversion: 2.20 time: 0.040437 May 23 12:49:09.258633 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 70/149] 10.222.0.45 () {60 vars in 1288 bytes} [Mon May 23 12:49:09 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 12:49:09.587339 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-764d62e3-f27e-486e-8f13-dbb3b36f8aae tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:09.588132 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-764d62e3-f27e-486e-8f13-dbb3b36f8aae tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:09.598210 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-764d62e3-f27e-486e-8f13-dbb3b36f8aae tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:09.598733 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-764d62e3-f27e-486e-8f13-dbb3b36f8aae tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:09.600768 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-764d62e3-f27e-486e-8f13-dbb3b36f8aae tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:09.601430 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-764d62e3-f27e-486e-8f13-dbb3b36f8aae tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:09.815841 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-764d62e3-f27e-486e-8f13-dbb3b36f8aae tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:09.825545 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-764d62e3-f27e-486e-8f13-dbb3b36f8aae tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1496 microversion: 2.1 time: 0.241671 May 23 12:49:09.826592 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 80/150] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:09 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1496 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:10.038883 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-92ae7179-58bc-4911-be67-481590924e5b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:10.039623 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-92ae7179-58bc-4911-be67-481590924e5b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:10.043016 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:10.051726 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-92ae7179-58bc-4911-be67-481590924e5b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:10.052125 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-92ae7179-58bc-4911-be67-481590924e5b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:10.052888 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-92ae7179-58bc-4911-be67-481590924e5b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:10.053347 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-92ae7179-58bc-4911-be67-481590924e5b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:10.099283 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-93c8965d-2027-49d9-b1e0-d71509f6e550 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:10.099817 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-93c8965d-2027-49d9-b1e0-d71509f6e550 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:10.108282 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-93c8965d-2027-49d9-b1e0-d71509f6e550 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:10.108732 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-93c8965d-2027-49d9-b1e0-d71509f6e550 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:10.109690 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-93c8965d-2027-49d9-b1e0-d71509f6e550 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:10.110465 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-93c8965d-2027-49d9-b1e0-d71509f6e550 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:10.215741 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-93c8965d-2027-49d9-b1e0-d71509f6e550 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:10.232272 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-93c8965d-2027-49d9-b1e0-d71509f6e550 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1271 microversion: 2.1 time: 0.137656 May 23 12:49:10.232919 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 81/151] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:10 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:10.276817 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1cee69e7-32e9-4a13-a7d9-d02bc9e4a839 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:10.277703 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1cee69e7-32e9-4a13-a7d9-d02bc9e4a839 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:10.284386 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1cee69e7-32e9-4a13-a7d9-d02bc9e4a839 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:10.285392 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1cee69e7-32e9-4a13-a7d9-d02bc9e4a839 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:10.286171 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1cee69e7-32e9-4a13-a7d9-d02bc9e4a839 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:10.286879 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1cee69e7-32e9-4a13-a7d9-d02bc9e4a839 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:10.290578 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-92ae7179-58bc-4911-be67-481590924e5b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:10.301711 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-92ae7179-58bc-4911-be67-481590924e5b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.269391 May 23 12:49:10.303587 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 71/152] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:10 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:10.463545 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1cee69e7-32e9-4a13-a7d9-d02bc9e4a839 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:10.475010 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1cee69e7-32e9-4a13-a7d9-d02bc9e4a839 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.203088 May 23 12:49:10.475601 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 82/153] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:10 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:11.200657 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-f6d725b9-1751-44f2-a043-674052f3dd5b req-78568f08-368c-4a28-a1a3-ae1337c513fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972e71db-3655-4632-8a33-7d00caa402f5", "tag": "24aa63ef-86a0-4942-aa7f-1d582e2e6280"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:11.211176 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-f6d725b9-1751-44f2-a043-674052f3dd5b req-78568f08-368c-4a28-a1a3-ae1337c513fc service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:11.211740 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-f6d725b9-1751-44f2-a043-674052f3dd5b req-78568f08-368c-4a28-a1a3-ae1337c513fc service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:11.225220 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-f6d725b9-1751-44f2-a043-674052f3dd5b req-78568f08-368c-4a28-a1a3-ae1337c513fc service nova] Creating event network-changed:24aa63ef-86a0-4942-aa7f-1d582e2e6280 for instance 972e71db-3655-4632-8a33-7d00caa402f5 on hv-cinder-maste May 23 12:49:11.230710 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-f6d725b9-1751-44f2-a043-674052f3dd5b req-78568f08-368c-4a28-a1a3-ae1337c513fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034441 May 23 12:49:11.231305 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 72/154] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:11.249548 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-33860d6c-cf8d-4809-8073-fa172d7630ec tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:11.250560 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-33860d6c-cf8d-4809-8073-fa172d7630ec tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:11.261805 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-33860d6c-cf8d-4809-8073-fa172d7630ec tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:11.262259 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-33860d6c-cf8d-4809-8073-fa172d7630ec tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:11.263048 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-33860d6c-cf8d-4809-8073-fa172d7630ec tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:11.263530 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-33860d6c-cf8d-4809-8073-fa172d7630ec tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:11.320358 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-721dc127-62e5-4e0d-a43b-fe5d0200fead tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:11.321392 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-721dc127-62e5-4e0d-a43b-fe5d0200fead tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:11.336744 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-721dc127-62e5-4e0d-a43b-fe5d0200fead tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:11.336744 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-721dc127-62e5-4e0d-a43b-fe5d0200fead tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:11.336744 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-721dc127-62e5-4e0d-a43b-fe5d0200fead tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:11.336744 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-721dc127-62e5-4e0d-a43b-fe5d0200fead tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:11.445936 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-33860d6c-cf8d-4809-8073-fa172d7630ec tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:11.455046 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-33860d6c-cf8d-4809-8073-fa172d7630ec tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1313 microversion: 2.1 time: 0.209722 May 23 12:49:11.455712 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 83/155] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:11 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:11.492845 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ac0d2d09-84e5-45ea-8e78-7b957087db0b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:11.494515 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ac0d2d09-84e5-45ea-8e78-7b957087db0b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:11.496713 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=8 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:11.502337 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac0d2d09-84e5-45ea-8e78-7b957087db0b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:11.503024 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac0d2d09-84e5-45ea-8e78-7b957087db0b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:11.503859 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac0d2d09-84e5-45ea-8e78-7b957087db0b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:11.504354 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac0d2d09-84e5-45ea-8e78-7b957087db0b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:11.574970 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-721dc127-62e5-4e0d-a43b-fe5d0200fead tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:11.583572 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-721dc127-62e5-4e0d-a43b-fe5d0200fead tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.267495 May 23 12:49:11.596518 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 73/156] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:11 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:11.629211 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7999a31c-dcc5-4f33-b99f-d73ed68083f2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:11.630034 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7999a31c-dcc5-4f33-b99f-d73ed68083f2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:11.643616 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7999a31c-dcc5-4f33-b99f-d73ed68083f2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:11.644135 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7999a31c-dcc5-4f33-b99f-d73ed68083f2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:11.646616 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7999a31c-dcc5-4f33-b99f-d73ed68083f2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:11.647502 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7999a31c-dcc5-4f33-b99f-d73ed68083f2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:11.664529 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ac0d2d09-84e5-45ea-8e78-7b957087db0b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:11.674711 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ac0d2d09-84e5-45ea-8e78-7b957087db0b tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.186374 May 23 12:49:11.684889 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 84/157] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:11 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:11.691524 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-7999a31c-dcc5-4f33-b99f-d73ed68083f2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lazy-loading 'flavor' on Instance uuid 0c365608-41a1-4663-b5e2-3481874a2325 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:49:11.911596 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-86fba579-fe01-43b3-8a03-ca2ffdbbb056 req-11d364d7-ff00-4090-bfba-428bab318925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3a8229-9fed-4b75-9391-782f4d06d316", "name": "network-vif-plugged", "status": "completed", "tag": "339b32e1-566b-4705-a78f-dda1a28241b8"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:11.923547 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-86fba579-fe01-43b3-8a03-ca2ffdbbb056 req-11d364d7-ff00-4090-bfba-428bab318925 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:11.924486 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-86fba579-fe01-43b3-8a03-ca2ffdbbb056 req-11d364d7-ff00-4090-bfba-428bab318925 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:11.952784 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-86fba579-fe01-43b3-8a03-ca2ffdbbb056 req-11d364d7-ff00-4090-bfba-428bab318925 service nova] Creating event network-vif-plugged:339b32e1-566b-4705-a78f-dda1a28241b8 for instance ba3a8229-9fed-4b75-9391-782f4d06d316 on hv-cinder-maste May 23 12:49:11.958589 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-86fba579-fe01-43b3-8a03-ca2ffdbbb056 req-11d364d7-ff00-4090-bfba-428bab318925 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050633 May 23 12:49:11.959887 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 85/158] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:49:12.117341 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7999a31c-dcc5-4f33-b99f-d73ed68083f2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "POST /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/action" status: 202 len: 0 microversion: 2.20 time: 0.488465 May 23 12:49:12.117341 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 74/159] 10.222.0.45 () {62 vars in 1318 bytes} [Mon May 23 12:49:11 2022] POST /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 12:49:12.126121 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-814313a9-dd5b-4de3-935e-acc085f3196a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:12.127054 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-814313a9-dd5b-4de3-935e-acc085f3196a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:12.133781 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-814313a9-dd5b-4de3-935e-acc085f3196a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.134305 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-814313a9-dd5b-4de3-935e-acc085f3196a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.135130 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-814313a9-dd5b-4de3-935e-acc085f3196a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.135557 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-814313a9-dd5b-4de3-935e-acc085f3196a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.271848 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-814313a9-dd5b-4de3-935e-acc085f3196a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:12.279712 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-814313a9-dd5b-4de3-935e-acc085f3196a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:12.281211 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-814313a9-dd5b-4de3-935e-acc085f3196a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:12.282351 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-814313a9-dd5b-4de3-935e-acc085f3196a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.163002 May 23 12:49:12.282959 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 86/160] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:12 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:12.474094 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-82fb3cfa-74f8-445e-b269-e0385d435a6b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:12.474779 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-82fb3cfa-74f8-445e-b269-e0385d435a6b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:12.482796 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-82fb3cfa-74f8-445e-b269-e0385d435a6b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.483230 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-82fb3cfa-74f8-445e-b269-e0385d435a6b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.483968 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-82fb3cfa-74f8-445e-b269-e0385d435a6b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.484395 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-82fb3cfa-74f8-445e-b269-e0385d435a6b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.568854 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-74544b30-113d-4c08-b771-5c85d7be7dd4 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:12.569369 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-74544b30-113d-4c08-b771-5c85d7be7dd4 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:12.575825 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-74544b30-113d-4c08-b771-5c85d7be7dd4 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.576271 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-74544b30-113d-4c08-b771-5c85d7be7dd4 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.577029 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-74544b30-113d-4c08-b771-5c85d7be7dd4 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.577511 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-74544b30-113d-4c08-b771-5c85d7be7dd4 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.604239 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-74544b30-113d-4c08-b771-5c85d7be7dd4 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:49:12.618024 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=100 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:12.626772 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-82fb3cfa-74f8-445e-b269-e0385d435a6b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:12.635103 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-82fb3cfa-74f8-445e-b269-e0385d435a6b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1313 microversion: 2.1 time: 0.165697 May 23 12:49:12.635677 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 75/161] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:12 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:12.643351 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-10a1aa2d-82ec-4d1f-9417-8f9e2c5da961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:12.644089 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-10a1aa2d-82ec-4d1f-9417-8f9e2c5da961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:12.650634 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10a1aa2d-82ec-4d1f-9417-8f9e2c5da961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.651141 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10a1aa2d-82ec-4d1f-9417-8f9e2c5da961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.651984 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10a1aa2d-82ec-4d1f-9417-8f9e2c5da961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.652485 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10a1aa2d-82ec-4d1f-9417-8f9e2c5da961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.684860 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-74544b30-113d-4c08-b771-5c85d7be7dd4 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "DELETE /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 204 len: 0 microversion: 2.1 time: 0.119749 May 23 12:49:12.697277 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 87/162] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:49:12 2022] DELETE /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 12:49:12.703254 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-cba144ef-f8b3-4b11-af7e-d9dea256349f tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:12.703984 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-cba144ef-f8b3-4b11-af7e-d9dea256349f tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:12.719018 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cba144ef-f8b3-4b11-af7e-d9dea256349f tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.719467 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cba144ef-f8b3-4b11-af7e-d9dea256349f tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.720248 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cba144ef-f8b3-4b11-af7e-d9dea256349f tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.720679 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cba144ef-f8b3-4b11-af7e-d9dea256349f tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.797098 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-10a1aa2d-82ec-4d1f-9417-8f9e2c5da961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:12.804533 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-10a1aa2d-82ec-4d1f-9417-8f9e2c5da961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.167685 May 23 12:49:12.805106 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 76/163] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:12 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:12.810498 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c04dfdbb-eb7f-44d8-973c-f59636a789e9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:12.811099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c04dfdbb-eb7f-44d8-973c-f59636a789e9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:12.816908 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c04dfdbb-eb7f-44d8-973c-f59636a789e9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.817392 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c04dfdbb-eb7f-44d8-973c-f59636a789e9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.818143 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c04dfdbb-eb7f-44d8-973c-f59636a789e9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:12.818573 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c04dfdbb-eb7f-44d8-973c-f59636a789e9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:12.865877 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-cba144ef-f8b3-4b11-af7e-d9dea256349f tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:12.874522 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-cba144ef-f8b3-4b11-af7e-d9dea256349f tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.175515 May 23 12:49:12.875109 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 88/164] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:12 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:12.961610 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c04dfdbb-eb7f-44d8-973c-f59636a789e9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:12.969305 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c04dfdbb-eb7f-44d8-973c-f59636a789e9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1502 microversion: 2.1 time: 0.162949 May 23 12:49:12.969870 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 77/165] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:12 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:13.303832 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ee06fd6c-119b-46b3-b405-09c5c5fa3f5a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:13.304340 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ee06fd6c-119b-46b3-b405-09c5c5fa3f5a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:13.311272 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ee06fd6c-119b-46b3-b405-09c5c5fa3f5a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:13.311865 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ee06fd6c-119b-46b3-b405-09c5c5fa3f5a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:13.312694 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ee06fd6c-119b-46b3-b405-09c5c5fa3f5a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:13.313226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ee06fd6c-119b-46b3-b405-09c5c5fa3f5a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:13.445475 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2a094256-005e-4a78-8977-5a8d1aac3389 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:13.446076 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2a094256-005e-4a78-8977-5a8d1aac3389 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:13.451172 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ee06fd6c-119b-46b3-b405-09c5c5fa3f5a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:13.452618 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2a094256-005e-4a78-8977-5a8d1aac3389 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:13.453066 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2a094256-005e-4a78-8977-5a8d1aac3389 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:13.453856 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2a094256-005e-4a78-8977-5a8d1aac3389 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:13.454285 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2a094256-005e-4a78-8977-5a8d1aac3389 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:13.458968 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ee06fd6c-119b-46b3-b405-09c5c5fa3f5a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:13.460502 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ee06fd6c-119b-46b3-b405-09c5c5fa3f5a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:13.461691 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ee06fd6c-119b-46b3-b405-09c5c5fa3f5a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.163247 May 23 12:49:13.462246 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 89/166] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:13 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:13.479878 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2a094256-005e-4a78-8977-5a8d1aac3389 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/ips" status: 200 len: 150 microversion: 2.1 time: 0.038300 May 23 12:49:13.480706 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 78/167] 10.222.0.45 () {58 vars in 1247 bytes} [Mon May 23 12:49:13 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:49:13.652100 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d7c04718-7705-4284-ab01-6939003584f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:13.652707 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d7c04718-7705-4284-ab01-6939003584f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:13.659210 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7c04718-7705-4284-ab01-6939003584f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:13.659651 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7c04718-7705-4284-ab01-6939003584f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:13.660408 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7c04718-7705-4284-ab01-6939003584f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:13.660857 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7c04718-7705-4284-ab01-6939003584f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:13.812359 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d7c04718-7705-4284-ab01-6939003584f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:13.825039 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f7657b9c-7b9b-435c-9c42-0dd1de9fb0b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:13.826388 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f7657b9c-7b9b-435c-9c42-0dd1de9fb0b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:13.828059 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d7c04718-7705-4284-ab01-6939003584f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1313 microversion: 2.1 time: 0.179780 May 23 12:49:13.829426 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 90/168] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:13 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:13.832392 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f7657b9c-7b9b-435c-9c42-0dd1de9fb0b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:13.832836 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f7657b9c-7b9b-435c-9c42-0dd1de9fb0b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:13.833777 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f7657b9c-7b9b-435c-9c42-0dd1de9fb0b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:13.834119 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f7657b9c-7b9b-435c-9c42-0dd1de9fb0b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:13.891532 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-bd892e50-a4c9-4caa-b5f1-2963d12bbd24 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:13.892155 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-bd892e50-a4c9-4caa-b5f1-2963d12bbd24 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:13.898719 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bd892e50-a4c9-4caa-b5f1-2963d12bbd24 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:13.899281 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bd892e50-a4c9-4caa-b5f1-2963d12bbd24 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:13.900149 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bd892e50-a4c9-4caa-b5f1-2963d12bbd24 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:13.900643 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bd892e50-a4c9-4caa-b5f1-2963d12bbd24 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:13.980219 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f7657b9c-7b9b-435c-9c42-0dd1de9fb0b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:13.992515 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f7657b9c-7b9b-435c-9c42-0dd1de9fb0b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.174120 May 23 12:49:13.993119 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 79/169] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:13 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:14.000982 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-541c5a5e-5a4d-491e-9033-a61423411618 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:14.001612 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-541c5a5e-5a4d-491e-9033-a61423411618 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:14.007835 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-541c5a5e-5a4d-491e-9033-a61423411618 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:14.008474 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-541c5a5e-5a4d-491e-9033-a61423411618 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:14.009256 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-541c5a5e-5a4d-491e-9033-a61423411618 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:14.009695 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-541c5a5e-5a4d-491e-9033-a61423411618 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:14.043408 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-bd892e50-a4c9-4caa-b5f1-2963d12bbd24 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:14.051078 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-bd892e50-a4c9-4caa-b5f1-2963d12bbd24 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.163378 May 23 12:49:14.051660 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 91/170] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:13 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:14.144660 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-541c5a5e-5a4d-491e-9033-a61423411618 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:14.152446 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-541c5a5e-5a4d-491e-9033-a61423411618 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1502 microversion: 2.1 time: 0.158192 May 23 12:49:14.153014 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 80/171] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:13 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:14.481374 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-fe8a4961-7a47-4de1-baab-9761f58a3a12 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:14.482027 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-fe8a4961-7a47-4de1-baab-9761f58a3a12 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:14.488038 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fe8a4961-7a47-4de1-baab-9761f58a3a12 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:14.488476 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fe8a4961-7a47-4de1-baab-9761f58a3a12 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:14.489248 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fe8a4961-7a47-4de1-baab-9761f58a3a12 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:14.489682 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fe8a4961-7a47-4de1-baab-9761f58a3a12 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:14.622627 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fe8a4961-7a47-4de1-baab-9761f58a3a12 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:14.630497 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fe8a4961-7a47-4de1-baab-9761f58a3a12 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:14.631991 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fe8a4961-7a47-4de1-baab-9761f58a3a12 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:14.633154 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-fe8a4961-7a47-4de1-baab-9761f58a3a12 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.156399 May 23 12:49:14.633711 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 92/172] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:14 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:14.829055 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f45b3d36-cfd7-4271-a0e7-d200f252f936 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdf05fad-d0d2-4093-87b6-b43db7810fd1"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:14.830148 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f45b3d36-cfd7-4271-a0e7-d200f252f936 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:14.836812 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f45b3d36-cfd7-4271-a0e7-d200f252f936 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:14.837295 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f45b3d36-cfd7-4271-a0e7-d200f252f936 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:14.838055 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f45b3d36-cfd7-4271-a0e7-d200f252f936 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:14.839946 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f45b3d36-cfd7-4271-a0e7-d200f252f936 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:14.845229 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-844d0b68-6b68-4e58-bc44-8d3b7be350a8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:14.845832 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-844d0b68-6b68-4e58-bc44-8d3b7be350a8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:14.851796 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-844d0b68-6b68-4e58-bc44-8d3b7be350a8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:14.852238 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-844d0b68-6b68-4e58-bc44-8d3b7be350a8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:14.852980 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-844d0b68-6b68-4e58-bc44-8d3b7be350a8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:14.853597 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-844d0b68-6b68-4e58-bc44-8d3b7be350a8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:15.027328 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:15.082985 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-844d0b68-6b68-4e58-bc44-8d3b7be350a8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:15.094580 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-844d0b68-6b68-4e58-bc44-8d3b7be350a8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1313 microversion: 2.1 time: 0.253300 May 23 12:49:15.095158 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 93/173] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:14 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:15.099569 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1ce5e302-9450-4cff-a865-4ef7291db12b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:15.101302 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1ce5e302-9450-4cff-a865-4ef7291db12b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:15.108402 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1ce5e302-9450-4cff-a865-4ef7291db12b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:15.108842 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1ce5e302-9450-4cff-a865-4ef7291db12b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:15.109703 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1ce5e302-9450-4cff-a865-4ef7291db12b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:15.110285 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1ce5e302-9450-4cff-a865-4ef7291db12b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:15.200705 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f45b3d36-cfd7-4271-a0e7-d200f252f936 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375425 May 23 12:49:15.206125 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 81/174] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:49:14 2022] POST /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:15.235976 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-46eedd5a-c6af-46bc-a4de-9b80cf90b99a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:15.236865 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-46eedd5a-c6af-46bc-a4de-9b80cf90b99a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:15.251047 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-46eedd5a-c6af-46bc-a4de-9b80cf90b99a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:15.251493 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-46eedd5a-c6af-46bc-a4de-9b80cf90b99a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:15.252258 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-46eedd5a-c6af-46bc-a4de-9b80cf90b99a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:15.252688 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-46eedd5a-c6af-46bc-a4de-9b80cf90b99a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:15.295414 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1ce5e302-9450-4cff-a865-4ef7291db12b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:15.303726 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1ce5e302-9450-4cff-a865-4ef7291db12b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.207551 May 23 12:49:15.305574 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 94/175] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:15 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:15.310844 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c9d0a1f9-172a-496c-913a-7db062b831a9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:15.311763 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c9d0a1f9-172a-496c-913a-7db062b831a9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:15.318030 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c9d0a1f9-172a-496c-913a-7db062b831a9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:15.318748 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c9d0a1f9-172a-496c-913a-7db062b831a9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:15.319685 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c9d0a1f9-172a-496c-913a-7db062b831a9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:15.320294 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c9d0a1f9-172a-496c-913a-7db062b831a9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:15.419323 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-46eedd5a-c6af-46bc-a4de-9b80cf90b99a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:15.428149 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-46eedd5a-c6af-46bc-a4de-9b80cf90b99a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.225125 May 23 12:49:15.428810 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 82/176] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:15 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:15.488504 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c9d0a1f9-172a-496c-913a-7db062b831a9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:15.496721 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c9d0a1f9-172a-496c-913a-7db062b831a9 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1502 microversion: 2.1 time: 0.189927 May 23 12:49:15.497322 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 95/177] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:15 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:15.652028 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-857992e1-d132-4157-be08-c060dd042fac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:15.652625 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-857992e1-d132-4157-be08-c060dd042fac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:15.665799 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-857992e1-d132-4157-be08-c060dd042fac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:15.667291 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-857992e1-d132-4157-be08-c060dd042fac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:15.668847 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-857992e1-d132-4157-be08-c060dd042fac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:15.669546 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-857992e1-d132-4157-be08-c060dd042fac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:15.854008 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-857992e1-d132-4157-be08-c060dd042fac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:15.865636 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-857992e1-d132-4157-be08-c060dd042fac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:15.867223 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-857992e1-d132-4157-be08-c060dd042fac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:15.868668 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-857992e1-d132-4157-be08-c060dd042fac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.221012 May 23 12:49:15.887144 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 83/178] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:15 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:16.087595 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-a14e6b8b-ccca-492a-96ea-55dd93c456fc req-9d2fbbf2-ff0b-46c9-9f74-d6855f69cf7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222c89a4-90e9-4202-9d7d-613791d2edb3", "name": "network-vif-deleted", "tag": "b4d80269-a059-46b6-b29d-262af496856a"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:16.097084 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-a14e6b8b-ccca-492a-96ea-55dd93c456fc req-9d2fbbf2-ff0b-46c9-9f74-d6855f69cf7d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.097556 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-a14e6b8b-ccca-492a-96ea-55dd93c456fc req-9d2fbbf2-ff0b-46c9-9f74-d6855f69cf7d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:16.109067 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-a14e6b8b-ccca-492a-96ea-55dd93c456fc req-9d2fbbf2-ff0b-46c9-9f74-d6855f69cf7d service nova] Creating event network-vif-deleted:b4d80269-a059-46b6-b29d-262af496856a for instance 222c89a4-90e9-4202-9d7d-613791d2edb3 on hv-cinder-maste May 23 12:49:16.113891 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-a14e6b8b-ccca-492a-96ea-55dd93c456fc req-9d2fbbf2-ff0b-46c9-9f74-d6855f69cf7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030165 May 23 12:49:16.114367 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ead86f56-68cf-40d1-b6f9-c6ed247e8a6f tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:16.114632 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 96/179] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:16.115489 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ead86f56-68cf-40d1-b6f9-c6ed247e8a6f tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:16.123235 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ead86f56-68cf-40d1-b6f9-c6ed247e8a6f tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.123687 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ead86f56-68cf-40d1-b6f9-c6ed247e8a6f tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:16.124457 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ead86f56-68cf-40d1-b6f9-c6ed247e8a6f tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.124894 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ead86f56-68cf-40d1-b6f9-c6ed247e8a6f tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:16.274963 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ead86f56-68cf-40d1-b6f9-c6ed247e8a6f tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:16.283545 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ead86f56-68cf-40d1-b6f9-c6ed247e8a6f tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1313 microversion: 2.1 time: 0.175349 May 23 12:49:16.284113 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 84/180] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:16 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:16.322918 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e220dcce-53f7-499c-bbd4-9e9a95d565c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:16.324529 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e220dcce-53f7-499c-bbd4-9e9a95d565c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:16.334691 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e220dcce-53f7-499c-bbd4-9e9a95d565c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.335142 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e220dcce-53f7-499c-bbd4-9e9a95d565c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:16.336024 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e220dcce-53f7-499c-bbd4-9e9a95d565c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.336377 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e220dcce-53f7-499c-bbd4-9e9a95d565c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:16.446646 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6d95651d-f052-4ed3-8ee8-ed4bb07a2d19 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:16.447461 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6d95651d-f052-4ed3-8ee8-ed4bb07a2d19 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:16.454747 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d95651d-f052-4ed3-8ee8-ed4bb07a2d19 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.455722 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d95651d-f052-4ed3-8ee8-ed4bb07a2d19 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:16.456717 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d95651d-f052-4ed3-8ee8-ed4bb07a2d19 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.457399 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d95651d-f052-4ed3-8ee8-ed4bb07a2d19 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:16.487431 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e220dcce-53f7-499c-bbd4-9e9a95d565c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:16.496141 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e220dcce-53f7-499c-bbd4-9e9a95d565c6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.177397 May 23 12:49:16.497448 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 97/181] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:16 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:16.515105 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b6a08f4f-8519-4d41-800a-e4c855803840 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:16.515838 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b6a08f4f-8519-4d41-800a-e4c855803840 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:16.522510 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b6a08f4f-8519-4d41-800a-e4c855803840 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.523025 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b6a08f4f-8519-4d41-800a-e4c855803840 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:16.524037 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b6a08f4f-8519-4d41-800a-e4c855803840 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.524463 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b6a08f4f-8519-4d41-800a-e4c855803840 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:16.607283 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b6a08f4f-8519-4d41-800a-e4c855803840 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:16.616525 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b6a08f4f-8519-4d41-800a-e4c855803840 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1460 microversion: 2.1 time: 0.106295 May 23 12:49:16.617948 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 98/182] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:16 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1460 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:16.832318 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6d95651d-f052-4ed3-8ee8-ed4bb07a2d19 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:16.840425 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6d95651d-f052-4ed3-8ee8-ed4bb07a2d19 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1315 microversion: 2.1 time: 0.398469 May 23 12:49:16.841335 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 85/183] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:16 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:16.891775 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-82f3b48b-7658-48d9-aa16-0458d529e84d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:16.892537 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-82f3b48b-7658-48d9-aa16-0458d529e84d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:16.900423 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-82f3b48b-7658-48d9-aa16-0458d529e84d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.901864 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-82f3b48b-7658-48d9-aa16-0458d529e84d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:16.903206 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-82f3b48b-7658-48d9-aa16-0458d529e84d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:16.903884 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-82f3b48b-7658-48d9-aa16-0458d529e84d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.063671 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-82f3b48b-7658-48d9-aa16-0458d529e84d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:17.071453 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-82f3b48b-7658-48d9-aa16-0458d529e84d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:17.073492 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-82f3b48b-7658-48d9-aa16-0458d529e84d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:17.074687 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-82f3b48b-7658-48d9-aa16-0458d529e84d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.187366 May 23 12:49:17.075244 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 99/184] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:16 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:17.302719 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f42693e8-c670-4cd4-be35-288e1c095c21 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:17.303328 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f42693e8-c670-4cd4-be35-288e1c095c21 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:17.310526 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f42693e8-c670-4cd4-be35-288e1c095c21 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:17.310975 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f42693e8-c670-4cd4-be35-288e1c095c21 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.311762 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f42693e8-c670-4cd4-be35-288e1c095c21 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:17.312198 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f42693e8-c670-4cd4-be35-288e1c095c21 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.458143 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f42693e8-c670-4cd4-be35-288e1c095c21 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:17.466616 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f42693e8-c670-4cd4-be35-288e1c095c21 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1313 microversion: 2.1 time: 0.167754 May 23 12:49:17.467186 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 86/185] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:17 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:17.514577 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-017e813a-5331-4fa1-aea1-be1ed739e1f3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:17.515177 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-017e813a-5331-4fa1-aea1-be1ed739e1f3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:17.521267 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-017e813a-5331-4fa1-aea1-be1ed739e1f3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:17.521708 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-017e813a-5331-4fa1-aea1-be1ed739e1f3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.522455 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-017e813a-5331-4fa1-aea1-be1ed739e1f3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:17.522883 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-017e813a-5331-4fa1-aea1-be1ed739e1f3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.635065 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:17.635890 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:17.641815 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:17.642261 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.643042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:17.643475 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.655286 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-017e813a-5331-4fa1-aea1-be1ed739e1f3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:17.663470 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-017e813a-5331-4fa1-aea1-be1ed739e1f3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.153304 May 23 12:49:17.664239 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 100/186] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:17 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:17.677477 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:17.677953 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.678389 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lazy-loading 'fault' on Instance uuid 222c89a4-90e9-4202-9d7d-613791d2edb3 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:49:17.722729 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1877c8dc1af45d3b4015950f8e51718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd0d4dd49c464bab39efeb0a87991d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:17.730767 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-bb863a4e-3d77-4703-bb97-9b4faa4c082c tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 200 len: 1303 microversion: 2.1 time: 0.099558 May 23 12:49:17.731552 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 87/187] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:17 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:17.860192 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9b1c59cb-6a4f-4536-b81f-7b2c1ba11e44 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:17.860192 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-9b1c59cb-6a4f-4536-b81f-7b2c1ba11e44 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:17.879638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9b1c59cb-6a4f-4536-b81f-7b2c1ba11e44 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:17.880362 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9b1c59cb-6a4f-4536-b81f-7b2c1ba11e44 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.881342 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9b1c59cb-6a4f-4536-b81f-7b2c1ba11e44 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:17.881969 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9b1c59cb-6a4f-4536-b81f-7b2c1ba11e44 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.889378 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-004d8a75-5634-4edb-914e-2926607a997d req-c52defa4-9509-4072-8c93-2d560d2ccab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972e71db-3655-4632-8a33-7d00caa402f5", "name": "network-vif-plugged", "status": "completed", "tag": "24aa63ef-86a0-4942-aa7f-1d582e2e6280"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:17.899143 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=4 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:17.903462 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-004d8a75-5634-4edb-914e-2926607a997d req-c52defa4-9509-4072-8c93-2d560d2ccab9 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:17.904234 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-004d8a75-5634-4edb-914e-2926607a997d req-c52defa4-9509-4072-8c93-2d560d2ccab9 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:17.920103 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-004d8a75-5634-4edb-914e-2926607a997d req-c52defa4-9509-4072-8c93-2d560d2ccab9 service nova] Creating event network-vif-plugged:24aa63ef-86a0-4942-aa7f-1d582e2e6280 for instance 972e71db-3655-4632-8a33-7d00caa402f5 on hv-cinder-maste May 23 12:49:17.923603 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=16 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:17.926037 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-004d8a75-5634-4edb-914e-2926607a997d req-c52defa4-9509-4072-8c93-2d560d2ccab9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042551 May 23 12:49:17.926812 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 88/188] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:18.043443 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9b1c59cb-6a4f-4536-b81f-7b2c1ba11e44 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:18.051166 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-9b1c59cb-6a4f-4536-b81f-7b2c1ba11e44 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1464 microversion: 2.1 time: 0.197864 May 23 12:49:18.051732 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 101/189] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:17 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1464 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:18.098862 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6dd3c8f7-fb5c-4bef-9ee9-467b21265af6 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:18.099418 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6dd3c8f7-fb5c-4bef-9ee9-467b21265af6 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:18.102681 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-de4e4894-35f0-43b9-a6e0-3408be036dcf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:18.103385 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-de4e4894-35f0-43b9-a6e0-3408be036dcf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:18.110486 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-de4e4894-35f0-43b9-a6e0-3408be036dcf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.110932 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-de4e4894-35f0-43b9-a6e0-3408be036dcf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.111693 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-de4e4894-35f0-43b9-a6e0-3408be036dcf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.112175 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-de4e4894-35f0-43b9-a6e0-3408be036dcf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.118429 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6dd3c8f7-fb5c-4bef-9ee9-467b21265af6 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.118902 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6dd3c8f7-fb5c-4bef-9ee9-467b21265af6 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.119678 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6dd3c8f7-fb5c-4bef-9ee9-467b21265af6 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.120263 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6dd3c8f7-fb5c-4bef-9ee9-467b21265af6 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.165638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6dd3c8f7-fb5c-4bef-9ee9-467b21265af6 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:49:18.229255 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:18.297050 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6dd3c8f7-fb5c-4bef-9ee9-467b21265af6 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 204 len: 0 microversion: 2.1 time: 0.201793 May 23 12:49:18.301218 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 102/190] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:49:18 2022] DELETE /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:49:18.315109 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-af59db9f-aa08-454b-9ee3-53b90c5dfee0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:18.315849 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-af59db9f-aa08-454b-9ee3-53b90c5dfee0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:18.336109 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-af59db9f-aa08-454b-9ee3-53b90c5dfee0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.336903 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-af59db9f-aa08-454b-9ee3-53b90c5dfee0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.337491 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-af59db9f-aa08-454b-9ee3-53b90c5dfee0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.337985 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-af59db9f-aa08-454b-9ee3-53b90c5dfee0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.348360 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-de4e4894-35f0-43b9-a6e0-3408be036dcf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:18.362320 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-de4e4894-35f0-43b9-a6e0-3408be036dcf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:18.364207 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-de4e4894-35f0-43b9-a6e0-3408be036dcf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:18.365576 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-de4e4894-35f0-43b9-a6e0-3408be036dcf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.275643 May 23 12:49:18.366958 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 89/191] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:18 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:18.483800 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ee99b3b1-0c2b-40c4-bb66-d3c8b66690b5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:18.485031 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ee99b3b1-0c2b-40c4-bb66-d3c8b66690b5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:18.491147 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ee99b3b1-0c2b-40c4-bb66-d3c8b66690b5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.491716 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ee99b3b1-0c2b-40c4-bb66-d3c8b66690b5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.493115 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ee99b3b1-0c2b-40c4-bb66-d3c8b66690b5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.493623 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ee99b3b1-0c2b-40c4-bb66-d3c8b66690b5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.507745 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-af59db9f-aa08-454b-9ee3-53b90c5dfee0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:18.517012 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-af59db9f-aa08-454b-9ee3-53b90c5dfee0 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1470 microversion: 2.1 time: 0.211140 May 23 12:49:18.517797 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 103/192] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:18 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1470 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:18.549090 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-15213004-5537-4411-9be7-5bce034c280c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: .version_select at 0x7f6a36fd6310>, body: {"keypair": {"name": "tempest-keypair-669597574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpnbAzo1Bi2weJtegG9NQYAlTaQODBgXvfFBdKsGmCzNuOR/WpE9Mz4jq0dGJZiflmZqTMRSmeiv4RsszNVcDFqBRvhxYzGVvUIncv5BUoUAmSIvsAt8DdTxxOgW4nVLg=="}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:18.562695 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-15213004-5537-4411-9be7-5bce034c280c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:49:18.566471 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-15213004-5537-4411-9be7-5bce034c280c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for user 2335faffe08d4c75ab85aa124819c513 and project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:49:18.590196 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-15213004-5537-4411-9be7-5bce034c280c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044745 May 23 12:49:18.590792 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 104/193] 10.222.0.45 () {60 vars in 1158 bytes} [Mon May 23 12:49:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:49:18.635896 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ee99b3b1-0c2b-40c4-bb66-d3c8b66690b5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:18.645180 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ee99b3b1-0c2b-40c4-bb66-d3c8b66690b5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1313 microversion: 2.1 time: 0.165232 May 23 12:49:18.645758 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 90/194] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:18 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:18.681182 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-415b426f-a00e-4c0b-9892-f03df28009ee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:18.681804 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-415b426f-a00e-4c0b-9892-f03df28009ee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:18.688741 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-415b426f-a00e-4c0b-9892-f03df28009ee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.689201 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-415b426f-a00e-4c0b-9892-f03df28009ee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.689955 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-415b426f-a00e-4c0b-9892-f03df28009ee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.690380 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-415b426f-a00e-4c0b-9892-f03df28009ee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.750143 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-299aeddc-1935-4def-b8d0-8405ecdafc11 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:18.750738 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-299aeddc-1935-4def-b8d0-8405ecdafc11 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] [instance: 222c89a4-90e9-4202-9d7d-613791d2edb3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:18.757004 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-299aeddc-1935-4def-b8d0-8405ecdafc11 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.757567 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-299aeddc-1935-4def-b8d0-8405ecdafc11 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.758248 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-299aeddc-1935-4def-b8d0-8405ecdafc11 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:18.758914 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-299aeddc-1935-4def-b8d0-8405ecdafc11 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:18.778828 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-299aeddc-1935-4def-b8d0-8405ecdafc11 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] HTTP exception thrown: Instance 222c89a4-90e9-4202-9d7d-613791d2edb3 could not be found. May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-299aeddc-1935-4def-b8d0-8405ecdafc11 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Request method failure captured: May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 HTTP/1.1 May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4K1XGkc4aW8-mlf5WnOCmQ9FiJpkPY43V5bXTPR0JBgBqj7MHVQqDXJJoJQe_1plOp8px3YZwHmLW_a7Dh-KOge8Po4Tn2EoLNDPI63gWKz7yzPSWwDfEuuk9rx_vp8Jju3sH2DRuf4_EAu47vGydGi-l5pDNG2WdIjvTOLYj31J24 May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: cbfd0d4dd49c464bab39efeb0a87991d May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-VolumesActionsTest-2042281389 May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:49:18.780531 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cbfd0d4dd49c464bab39efeb0a87991d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cbfd0d4dd49c464bab39efeb0a87991d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cbfd0d4dd49c464bab39efeb0a87991d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cbfd0d4dd49c464bab39efeb0a87991d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-VolumesActionsTest-2042281389 May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: cbfd0d4dd49c464bab39efeb0a87991d May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-VolumesActionsTest-2042281389 May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-VolumesActionsTest-2042281389-project May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: f1877c8dc1af45d3b4015950f8e51718 May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-VolumesActionsTest-2042281389-project May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 222c89a4-90e9-4202-9d7d-613791d2edb3 could not be found. May 23 12:49:18.781757 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '222c89a4-90e9-4202-9d7d-613791d2edb3'} May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222c89a4-90e9-4202-9d7d-613791d2edb3 could not be found. May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:49:18.782439 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222c89a4-90e9-4202-9d7d-613791d2edb3 could not be found. May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222c89a4-90e9-4202-9d7d-613791d2edb3 could not be found. May 23 12:49:18.783484 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:49:18.784514 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-299aeddc-1935-4def-b8d0-8405ecdafc11 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] Returning 404 to user: Instance 222c89a4-90e9-4202-9d7d-613791d2edb3 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:49:18.784514 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-299aeddc-1935-4def-b8d0-8405ecdafc11 tempest-VolumesActionsTest-2042281389 tempest-VolumesActionsTest-2042281389-project] 10.222.0.45 "GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3" status: 404 len: 111 microversion: 2.1 time: 0.035691 May 23 12:49:18.786114 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 91/195] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:18 2022] GET /compute/v2.1/servers/222c89a4-90e9-4202-9d7d-613791d2edb3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:49:18.895002 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-415b426f-a00e-4c0b-9892-f03df28009ee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:18.909347 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-415b426f-a00e-4c0b-9892-f03df28009ee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.231260 May 23 12:49:18.911491 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 105/196] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:18 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:19.387737 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0338c071-ebf0-48cf-bd6f-e7d3ae96f605 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:19.388424 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0338c071-ebf0-48cf-bd6f-e7d3ae96f605 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:19.394854 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0338c071-ebf0-48cf-bd6f-e7d3ae96f605 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:19.395336 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0338c071-ebf0-48cf-bd6f-e7d3ae96f605 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:19.396092 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0338c071-ebf0-48cf-bd6f-e7d3ae96f605 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:19.396520 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0338c071-ebf0-48cf-bd6f-e7d3ae96f605 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:19.535007 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-86a72b4a-35df-4ae4-88c6-e1e09f9e2c82 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:19.535615 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-86a72b4a-35df-4ae4-88c6-e1e09f9e2c82 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:19.543159 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-86a72b4a-35df-4ae4-88c6-e1e09f9e2c82 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:19.543825 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-86a72b4a-35df-4ae4-88c6-e1e09f9e2c82 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:19.544783 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-86a72b4a-35df-4ae4-88c6-e1e09f9e2c82 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:19.545404 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-86a72b4a-35df-4ae4-88c6-e1e09f9e2c82 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:19.616220 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0338c071-ebf0-48cf-bd6f-e7d3ae96f605 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:19.625320 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0338c071-ebf0-48cf-bd6f-e7d3ae96f605 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:19.626801 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0338c071-ebf0-48cf-bd6f-e7d3ae96f605 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:19.627946 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0338c071-ebf0-48cf-bd6f-e7d3ae96f605 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.246044 May 23 12:49:19.628492 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 92/197] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:19 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:19.664755 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6411f105-1e59-43c6-9246-406d2567b817 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:19.665722 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6411f105-1e59-43c6-9246-406d2567b817 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:19.672547 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6411f105-1e59-43c6-9246-406d2567b817 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:19.673345 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6411f105-1e59-43c6-9246-406d2567b817 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:19.674390 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6411f105-1e59-43c6-9246-406d2567b817 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:19.675005 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6411f105-1e59-43c6-9246-406d2567b817 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:19.690278 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-86a72b4a-35df-4ae4-88c6-e1e09f9e2c82 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:19.698866 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-86a72b4a-35df-4ae4-88c6-e1e09f9e2c82 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1470 microversion: 2.1 time: 0.167116 May 23 12:49:19.699451 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 106/198] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:19 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:19.930740 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b31d2ce3-e6d6-4e55-b9f8-6d3cfad691ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:19.931343 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b31d2ce3-e6d6-4e55-b9f8-6d3cfad691ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:19.937750 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b31d2ce3-e6d6-4e55-b9f8-6d3cfad691ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:19.938199 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b31d2ce3-e6d6-4e55-b9f8-6d3cfad691ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:19.938965 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b31d2ce3-e6d6-4e55-b9f8-6d3cfad691ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:19.939395 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b31d2ce3-e6d6-4e55-b9f8-6d3cfad691ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:19.953474 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6411f105-1e59-43c6-9246-406d2567b817 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:19.961862 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6411f105-1e59-43c6-9246-406d2567b817 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1313 microversion: 2.1 time: 0.302741 May 23 12:49:19.973178 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 93/199] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:19 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:20.083180 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b31d2ce3-e6d6-4e55-b9f8-6d3cfad691ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:20.092333 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b31d2ce3-e6d6-4e55-b9f8-6d3cfad691ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.164743 May 23 12:49:20.098380 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 107/200] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:19 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:20.259577 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1775239927", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6101120e-4403-4c14-bcc5-167e49bfb907"}], "security_groups": [{"name": "tempest-securitygroup--2122188636"}], "key_name": "tempest-keypair-669597574", "user_data": "}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:20.469204 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] validate_networks() for [('6101120e-4403-4c14-bcc5-167e49bfb907', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:49:20.647665 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-0da83250-f771-4641-95fa-a5725f8b27c2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:20.648995 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-0da83250-f771-4641-95fa-a5725f8b27c2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:20.655786 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0da83250-f771-4641-95fa-a5725f8b27c2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:20.656462 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0da83250-f771-4641-95fa-a5725f8b27c2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:20.657437 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0da83250-f771-4641-95fa-a5725f8b27c2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:20.658010 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0da83250-f771-4641-95fa-a5725f8b27c2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:20.862454 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-0da83250-f771-4641-95fa-a5725f8b27c2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:20.870887 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-0da83250-f771-4641-95fa-a5725f8b27c2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:20.872400 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-0da83250-f771-4641-95fa-a5725f8b27c2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:20.873607 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-0da83250-f771-4641-95fa-a5725f8b27c2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.230679 May 23 12:49:20.876368 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 108/201] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:20 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:20.880792 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-905a0e82-e56e-4b82-a7e6-e3d3f2ab9927 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:20.881653 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-905a0e82-e56e-4b82-a7e6-e3d3f2ab9927 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:20.890243 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-905a0e82-e56e-4b82-a7e6-e3d3f2ab9927 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:20.890695 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-905a0e82-e56e-4b82-a7e6-e3d3f2ab9927 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:20.891472 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-905a0e82-e56e-4b82-a7e6-e3d3f2ab9927 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:20.891907 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-905a0e82-e56e-4b82-a7e6-e3d3f2ab9927 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:21.116870 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-905a0e82-e56e-4b82-a7e6-e3d3f2ab9927 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:21.138927 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-905a0e82-e56e-4b82-a7e6-e3d3f2ab9927 tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1470 microversion: 2.1 time: 0.253699 May 23 12:49:21.140685 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 109/202] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:20 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:21.147781 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b036454c-dd10-454f-aef3-67548284e1f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:21.147781 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b036454c-dd10-454f-aef3-67548284e1f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:21.159899 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b036454c-dd10-454f-aef3-67548284e1f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:21.160315 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b036454c-dd10-454f-aef3-67548284e1f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:21.161455 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b036454c-dd10-454f-aef3-67548284e1f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:21.162033 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b036454c-dd10-454f-aef3-67548284e1f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:21.262084 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:49:21.262499 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:49:21.263889 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:49:21.264333 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:49:21.264741 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:49:21.281670 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:21.282498 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:21.283401 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:21.283808 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:21.303635 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:49:21.308909 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for user 2335faffe08d4c75ab85aa124819c513 and project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:49:21.324963 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:49:21.330112 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:49:21.376554 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b036454c-dd10-454f-aef3-67548284e1f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:21.388384 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b036454c-dd10-454f-aef3-67548284e1f0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1313 microversion: 2.1 time: 0.246226 May 23 12:49:21.389618 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 110/203] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:21 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:21.395055 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e486a5a8-6077-4adb-acff-cd7b1d6a4554 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:21.395681 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e486a5a8-6077-4adb-acff-cd7b1d6a4554 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:21.403212 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e486a5a8-6077-4adb-acff-cd7b1d6a4554 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:21.404523 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e486a5a8-6077-4adb-acff-cd7b1d6a4554 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:21.405618 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e486a5a8-6077-4adb-acff-cd7b1d6a4554 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:21.406451 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e486a5a8-6077-4adb-acff-cd7b1d6a4554 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:21.434085 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ca579a6a-d3fd-4fbd-9bcd-4b74c6efad72 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.178653 May 23 12:49:21.436811 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 94/204] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:49:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:49:21.444952 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-8e8d76bc-8494-4bb2-8b6f-d8c03d3e4547 req-97d6b447-8f1e-4ddf-8471-f43be1251cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3a8229-9fed-4b75-9391-782f4d06d316", "name": "network-vif-deleted", "tag": "339b32e1-566b-4705-a78f-dda1a28241b8"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:21.461849 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-8e8d76bc-8494-4bb2-8b6f-d8c03d3e4547 req-97d6b447-8f1e-4ddf-8471-f43be1251cc2 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:21.462594 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-8e8d76bc-8494-4bb2-8b6f-d8c03d3e4547 req-97d6b447-8f1e-4ddf-8471-f43be1251cc2 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:21.477049 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-8e8d76bc-8494-4bb2-8b6f-d8c03d3e4547 req-97d6b447-8f1e-4ddf-8471-f43be1251cc2 service nova] Creating event network-vif-deleted:339b32e1-566b-4705-a78f-dda1a28241b8 for instance ba3a8229-9fed-4b75-9391-782f4d06d316 on hv-cinder-maste May 23 12:49:21.487023 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-8e8d76bc-8494-4bb2-8b6f-d8c03d3e4547 req-97d6b447-8f1e-4ddf-8471-f43be1251cc2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048495 May 23 12:49:21.488053 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 95/205] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:21.501016 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-35cbd178-1fbe-4ca3-85b5-a2507887463e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:21.507026 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-35cbd178-1fbe-4ca3-85b5-a2507887463e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:21.603600 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e486a5a8-6077-4adb-acff-cd7b1d6a4554 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:21.622504 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e486a5a8-6077-4adb-acff-cd7b1d6a4554 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.230985 May 23 12:49:21.623006 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 111/206] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:21 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:21.635690 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-35cbd178-1fbe-4ca3-85b5-a2507887463e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:21.644389 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-35cbd178-1fbe-4ca3-85b5-a2507887463e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1241 microversion: 2.1 time: 0.150281 May 23 12:49:21.645466 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 96/207] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:21 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:21.897302 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c728a05e-d0fe-45e6-9dee-b37a0762ead5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:21.898740 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c728a05e-d0fe-45e6-9dee-b37a0762ead5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:21.912686 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c728a05e-d0fe-45e6-9dee-b37a0762ead5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:21.914232 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c728a05e-d0fe-45e6-9dee-b37a0762ead5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:21.917160 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c728a05e-d0fe-45e6-9dee-b37a0762ead5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:21.918271 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c728a05e-d0fe-45e6-9dee-b37a0762ead5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:22.117527 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c728a05e-d0fe-45e6-9dee-b37a0762ead5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:22.126111 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c728a05e-d0fe-45e6-9dee-b37a0762ead5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:22.127632 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c728a05e-d0fe-45e6-9dee-b37a0762ead5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:22.128771 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c728a05e-d0fe-45e6-9dee-b37a0762ead5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.239925 May 23 12:49:22.129365 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 112/208] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:21 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:22.156177 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:22.156771 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:22.162880 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:22.163324 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:22.164076 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:22.164501 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:22.195841 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:22.196286 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:22.196729 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lazy-loading 'fault' on Instance uuid ba3a8229-9fed-4b75-9391-782f4d06d316 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:49:22.239772 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabb186921a475b8aae82a55a3b35d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d69183d45fe4f1baa8f71d86c1d6375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:22.247404 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-66b7825e-b0f6-4283-bc82-395dbd3e9a1a tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 200 len: 1305 microversion: 2.1 time: 0.095134 May 23 12:49:22.248003 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 97/209] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:22 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:22.411295 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4f30087e-022f-4c63-bd81-a3c0d1ae09c0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:22.412876 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4f30087e-022f-4c63-bd81-a3c0d1ae09c0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:22.426301 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4f30087e-022f-4c63-bd81-a3c0d1ae09c0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:22.428872 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4f30087e-022f-4c63-bd81-a3c0d1ae09c0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:22.431987 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4f30087e-022f-4c63-bd81-a3c0d1ae09c0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:22.433162 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4f30087e-022f-4c63-bd81-a3c0d1ae09c0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:22.606518 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4f30087e-022f-4c63-bd81-a3c0d1ae09c0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:22.615844 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4f30087e-022f-4c63-bd81-a3c0d1ae09c0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1497 microversion: 2.1 time: 0.213943 May 23 12:49:22.616671 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 113/210] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:22 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:22.641672 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2232a100-a475-4d15-a348-24580a4af129 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:22.642286 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2232a100-a475-4d15-a348-24580a4af129 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:22.651903 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2232a100-a475-4d15-a348-24580a4af129 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:22.652385 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2232a100-a475-4d15-a348-24580a4af129 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:22.653178 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2232a100-a475-4d15-a348-24580a4af129 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:22.653615 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2232a100-a475-4d15-a348-24580a4af129 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:22.661257 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-339ab6eb-849c-4a0b-9585-1716606cf5ce tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:22.661864 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-339ab6eb-849c-4a0b-9585-1716606cf5ce tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:22.671838 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-339ab6eb-849c-4a0b-9585-1716606cf5ce tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:22.672290 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-339ab6eb-849c-4a0b-9585-1716606cf5ce tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:22.673179 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-339ab6eb-849c-4a0b-9585-1716606cf5ce tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:22.673627 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-339ab6eb-849c-4a0b-9585-1716606cf5ce tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:22.744169 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-339ab6eb-849c-4a0b-9585-1716606cf5ce tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:22.752888 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-339ab6eb-849c-4a0b-9585-1716606cf5ce tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1293 microversion: 2.1 time: 0.095391 May 23 12:49:22.754102 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 114/211] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:22 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:22.937361 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2232a100-a475-4d15-a348-24580a4af129 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:22.953611 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2232a100-a475-4d15-a348-24580a4af129 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.315999 May 23 12:49:22.954224 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 98/212] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:22 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:23.121662 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c19d2887-e279-4e7b-bda3-9c307070be34 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:23.122115 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c19d2887-e279-4e7b-bda3-9c307070be34 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:23.138698 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c19d2887-e279-4e7b-bda3-9c307070be34 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.139467 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c19d2887-e279-4e7b-bda3-9c307070be34 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.140392 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c19d2887-e279-4e7b-bda3-9c307070be34 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.141428 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c19d2887-e279-4e7b-bda3-9c307070be34 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.149508 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3bb8fe75-2da0-4395-8ff9-9b050338356b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:23.150470 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3bb8fe75-2da0-4395-8ff9-9b050338356b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:23.178170 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3bb8fe75-2da0-4395-8ff9-9b050338356b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.180162 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3bb8fe75-2da0-4395-8ff9-9b050338356b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.181097 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c19d2887-e279-4e7b-bda3-9c307070be34 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:49:23.183624 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3bb8fe75-2da0-4395-8ff9-9b050338356b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.185573 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3bb8fe75-2da0-4395-8ff9-9b050338356b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.264017 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:23.308323 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c19d2887-e279-4e7b-bda3-9c307070be34 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "DELETE /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 204 len: 0 microversion: 2.1 time: 0.190801 May 23 12:49:23.308909 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 115/213] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:49:23 2022] DELETE /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:49:23.314333 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a011a961-87e9-41f2-85bb-b5dac0ce29ff tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:23.315268 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a011a961-87e9-41f2-85bb-b5dac0ce29ff tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] [instance: ba3a8229-9fed-4b75-9391-782f4d06d316] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:23.321260 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a011a961-87e9-41f2-85bb-b5dac0ce29ff tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.321704 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a011a961-87e9-41f2-85bb-b5dac0ce29ff tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.322494 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a011a961-87e9-41f2-85bb-b5dac0ce29ff tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.323719 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a011a961-87e9-41f2-85bb-b5dac0ce29ff tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.340774 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-a011a961-87e9-41f2-85bb-b5dac0ce29ff tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] HTTP exception thrown: Instance ba3a8229-9fed-4b75-9391-782f4d06d316 could not be found. May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a011a961-87e9-41f2-85bb-b5dac0ce29ff tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Request method failure captured: May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 HTTP/1.1 May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4K6BjXLEd3ziKMD6EGVaSTWb21onYjP15m63KX9BWSPbv8ZEGaQcDnJI8EIgTN2MiGVvr0aHjOVE2QonYL41ZXwWaH_ZUuNMcklIdb7R3q4a9zDbbrEL3PVKYew1EvV85eQvbdWDxVtwsqTgEwzn_djjpohwWAFlDaldGKAW5gv4Wo May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 0d69183d45fe4f1baa8f71d86c1d6375 May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesNegativeTest-151625770 May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:49:23.342939 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d69183d45fe4f1baa8f71d86c1d6375"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d69183d45fe4f1baa8f71d86c1d6375"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d69183d45fe4f1baa8f71d86c1d6375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d69183d45fe4f1baa8f71d86c1d6375"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesNegativeTest-151625770 May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 0d69183d45fe4f1baa8f71d86c1d6375 May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesNegativeTest-151625770 May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesNegativeTest-151625770-project May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 2eabb186921a475b8aae82a55a3b35d5 May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesNegativeTest-151625770-project May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance ba3a8229-9fed-4b75-9391-782f4d06d316 could not be found. May 23 12:49:23.344091 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'ba3a8229-9fed-4b75-9391-782f4d06d316'} May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3a8229-9fed-4b75-9391-782f4d06d316 could not be found. May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:49:23.344793 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3a8229-9fed-4b75-9391-782f4d06d316 could not be found. May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3a8229-9fed-4b75-9391-782f4d06d316 could not be found. May 23 12:49:23.347427 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:49:23.348418 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a011a961-87e9-41f2-85bb-b5dac0ce29ff tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] Returning 404 to user: Instance ba3a8229-9fed-4b75-9391-782f4d06d316 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:49:23.348418 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a011a961-87e9-41f2-85bb-b5dac0ce29ff tempest-VolumesNegativeTest-151625770 tempest-VolumesNegativeTest-151625770-project] 10.222.0.45 "GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316" status: 404 len: 111 microversion: 2.1 time: 0.034107 May 23 12:49:23.352810 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 116/214] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:23 2022] GET /compute/v2.1/servers/ba3a8229-9fed-4b75-9391-782f4d06d316 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:49:23.365490 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a9de59e5-a724-4a18-a224-1e452d7789a6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:23.366099 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a9de59e5-a724-4a18-a224-1e452d7789a6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:23.375506 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a9de59e5-a724-4a18-a224-1e452d7789a6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.376423 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a9de59e5-a724-4a18-a224-1e452d7789a6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.377418 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a9de59e5-a724-4a18-a224-1e452d7789a6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.378040 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a9de59e5-a724-4a18-a224-1e452d7789a6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.470494 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3bb8fe75-2da0-4395-8ff9-9b050338356b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:23.499040 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3bb8fe75-2da0-4395-8ff9-9b050338356b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:23.502986 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3bb8fe75-2da0-4395-8ff9-9b050338356b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:23.504742 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3bb8fe75-2da0-4395-8ff9-9b050338356b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.361327 May 23 12:49:23.506135 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 99/215] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:23 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:49:23.542511 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a9de59e5-a724-4a18-a224-1e452d7789a6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:23.557850 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a9de59e5-a724-4a18-a224-1e452d7789a6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1503 microversion: 2.1 time: 0.195650 May 23 12:49:23.558437 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 117/216] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:23 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:23.772425 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-eef8f681-73e1-4bb1-82be-2f289a815b5d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:23.773017 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-eef8f681-73e1-4bb1-82be-2f289a815b5d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:23.784185 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eef8f681-73e1-4bb1-82be-2f289a815b5d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.784853 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eef8f681-73e1-4bb1-82be-2f289a815b5d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.791963 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eef8f681-73e1-4bb1-82be-2f289a815b5d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.792679 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eef8f681-73e1-4bb1-82be-2f289a815b5d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.818574 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:23.868476 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-eef8f681-73e1-4bb1-82be-2f289a815b5d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:23.882447 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-eef8f681-73e1-4bb1-82be-2f289a815b5d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1299 microversion: 2.1 time: 0.114218 May 23 12:49:23.883026 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 100/217] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:23 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:23.971571 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-35778618-0834-4b38-aa74-65a0982ef5ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:23.972558 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-35778618-0834-4b38-aa74-65a0982ef5ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:23.982125 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-35778618-0834-4b38-aa74-65a0982ef5ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.982755 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-35778618-0834-4b38-aa74-65a0982ef5ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:23.983762 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-35778618-0834-4b38-aa74-65a0982ef5ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:23.984504 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-35778618-0834-4b38-aa74-65a0982ef5ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:24.170531 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-35778618-0834-4b38-aa74-65a0982ef5ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:24.171412 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:24.182085 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-35778618-0834-4b38-aa74-65a0982ef5ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.215025 May 23 12:49:24.197353 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 118/218] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:23 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:24.529249 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-10144695-773b-463d-ba9e-5294555599b1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:24.529865 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-10144695-773b-463d-ba9e-5294555599b1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:24.536683 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10144695-773b-463d-ba9e-5294555599b1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:24.537349 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10144695-773b-463d-ba9e-5294555599b1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:24.538188 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10144695-773b-463d-ba9e-5294555599b1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:24.538691 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10144695-773b-463d-ba9e-5294555599b1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:24.578483 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-434b0275-5584-412b-b961-4fe7b8ca4bc8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:24.579373 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-434b0275-5584-412b-b961-4fe7b8ca4bc8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:24.589606 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-434b0275-5584-412b-b961-4fe7b8ca4bc8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:24.590348 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-434b0275-5584-412b-b961-4fe7b8ca4bc8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:24.595950 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-434b0275-5584-412b-b961-4fe7b8ca4bc8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:24.596701 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-434b0275-5584-412b-b961-4fe7b8ca4bc8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:24.738914 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-10144695-773b-463d-ba9e-5294555599b1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:24.751286 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-10144695-773b-463d-ba9e-5294555599b1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:24.753050 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-10144695-773b-463d-ba9e-5294555599b1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:24.756428 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-10144695-773b-463d-ba9e-5294555599b1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.232744 May 23 12:49:24.761486 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 101/219] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:24 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:24.781178 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-434b0275-5584-412b-b961-4fe7b8ca4bc8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:24.795047 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-434b0275-5584-412b-b961-4fe7b8ca4bc8 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1503 microversion: 2.1 time: 0.222433 May 23 12:49:24.796665 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 119/220] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:24 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:24.901008 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b8d85b33-80f4-4326-bbb3-f010753a4d19 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:24.902891 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b8d85b33-80f4-4326-bbb3-f010753a4d19 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:24.912346 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8d85b33-80f4-4326-bbb3-f010753a4d19 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:24.913026 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8d85b33-80f4-4326-bbb3-f010753a4d19 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:24.914322 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8d85b33-80f4-4326-bbb3-f010753a4d19 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:24.914977 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8d85b33-80f4-4326-bbb3-f010753a4d19 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:25.024984 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b8d85b33-80f4-4326-bbb3-f010753a4d19 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:25.033704 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b8d85b33-80f4-4326-bbb3-f010753a4d19 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1299 microversion: 2.1 time: 0.137494 May 23 12:49:25.034518 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 102/221] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:24 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:25.200236 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-26a9d436-9c22-4952-9a4a-2d8890c3f0cb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:25.200855 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-26a9d436-9c22-4952-9a4a-2d8890c3f0cb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:25.212835 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-26a9d436-9c22-4952-9a4a-2d8890c3f0cb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:25.214800 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-26a9d436-9c22-4952-9a4a-2d8890c3f0cb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:25.215646 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-26a9d436-9c22-4952-9a4a-2d8890c3f0cb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:25.216884 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-26a9d436-9c22-4952-9a4a-2d8890c3f0cb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:25.373133 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-853408334", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "networks": [{"uuid": "2a3805bb-a52c-4ab6-9e3f-bf6b54400956"}]}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:25.449012 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] validate_networks() for [('2a3805bb-a52c-4ab6-9e3f-bf6b54400956', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:49:25.499796 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-26a9d436-9c22-4952-9a4a-2d8890c3f0cb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:25.511264 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-26a9d436-9c22-4952-9a4a-2d8890c3f0cb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.316279 May 23 12:49:25.515661 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 120/222] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:25 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:25.750856 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-eb32c242-4308-41ad-8d1a-42f6ebf42355 req-a755712a-4461-45a9-8c00-8c22ece6bcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972e71db-3655-4632-8a33-7d00caa402f5", "name": "network-vif-deleted", "tag": "24aa63ef-86a0-4942-aa7f-1d582e2e6280"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:25.765290 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-eb32c242-4308-41ad-8d1a-42f6ebf42355 req-a755712a-4461-45a9-8c00-8c22ece6bcf6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:25.765740 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-eb32c242-4308-41ad-8d1a-42f6ebf42355 req-a755712a-4461-45a9-8c00-8c22ece6bcf6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:25.782553 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-eb32c242-4308-41ad-8d1a-42f6ebf42355 req-a755712a-4461-45a9-8c00-8c22ece6bcf6 service nova] Creating event network-vif-deleted:24aa63ef-86a0-4942-aa7f-1d582e2e6280 for instance 972e71db-3655-4632-8a33-7d00caa402f5 on hv-cinder-maste May 23 12:49:25.790781 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-eb32c242-4308-41ad-8d1a-42f6ebf42355 req-a755712a-4461-45a9-8c00-8c22ece6bcf6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043652 May 23 12:49:25.793814 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 121/223] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:25.802191 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-93621e10-aa83-4957-bb82-57ef303f6ed9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:25.803199 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-93621e10-aa83-4957-bb82-57ef303f6ed9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:25.814219 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-93621e10-aa83-4957-bb82-57ef303f6ed9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:25.815077 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-93621e10-aa83-4957-bb82-57ef303f6ed9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:25.816043 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-93621e10-aa83-4957-bb82-57ef303f6ed9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:25.816762 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-93621e10-aa83-4957-bb82-57ef303f6ed9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:26.037221 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-93621e10-aa83-4957-bb82-57ef303f6ed9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:26.048729 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-93621e10-aa83-4957-bb82-57ef303f6ed9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:26.050631 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-93621e10-aa83-4957-bb82-57ef303f6ed9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:26.052115 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-93621e10-aa83-4957-bb82-57ef303f6ed9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.255566 May 23 12:49:26.064793 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 122/224] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:25 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:26.070332 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:26.071157 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:26.078129 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:26.079339 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:26.081027 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:26.081677 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:26.123322 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:26.124023 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:26.124676 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lazy-loading 'fault' on Instance uuid 972e71db-3655-4632-8a33-7d00caa402f5 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:49:26.205792 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:26.218064 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-732156a6-017a-4936-8c3f-318282b7b36b tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 200 len: 1303 microversion: 2.1 time: 0.151676 May 23 12:49:26.218652 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 123/225] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:26 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:26.240532 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-623a32bf-d46e-469f-8e62-a33c6471901e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:26.241172 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-623a32bf-d46e-469f-8e62-a33c6471901e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:26.250393 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-623a32bf-d46e-469f-8e62-a33c6471901e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:26.251068 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-623a32bf-d46e-469f-8e62-a33c6471901e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:26.263617 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-623a32bf-d46e-469f-8e62-a33c6471901e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:26.264292 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-623a32bf-d46e-469f-8e62-a33c6471901e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:26.458819 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-623a32bf-d46e-469f-8e62-a33c6471901e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:26.470246 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-623a32bf-d46e-469f-8e62-a33c6471901e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1367 microversion: 2.1 time: 0.235916 May 23 12:49:26.481505 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 124/226] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:26 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:26.529549 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-19dfc497-9f42-4c55-9012-cc6501fe0dbb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:26.530204 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-19dfc497-9f42-4c55-9012-cc6501fe0dbb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:26.542988 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-19dfc497-9f42-4c55-9012-cc6501fe0dbb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:26.543459 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-19dfc497-9f42-4c55-9012-cc6501fe0dbb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:26.545446 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-19dfc497-9f42-4c55-9012-cc6501fe0dbb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:26.545890 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-19dfc497-9f42-4c55-9012-cc6501fe0dbb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:26.580157 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:49:26.580620 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:49:26.581029 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:49:26.581770 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:49:26.582331 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:49:26.594066 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:26.594799 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:26.596117 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:26.596776 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:26.617928 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Getting quotas for project 138b75f9014a4698b462d0c7483b9420. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:49:26.624904 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Getting quotas for user b4f6e3f8e0f2431888f20f91fb469c72 and project 138b75f9014a4698b462d0c7483b9420. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:49:26.637428 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:49:26.639726 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:49:26.659210 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:26.719284 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0888e0c7-561e-4b82-8c03-535076fbefdf tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349629 May 23 12:49:26.721319 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 103/227] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:49:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:49:26.733844 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b7a2f23a-b4bc-47f0-ab09-9586def34c0d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:26.734635 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b7a2f23a-b4bc-47f0-ab09-9586def34c0d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:26.755747 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-19dfc497-9f42-4c55-9012-cc6501fe0dbb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:26.767854 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-19dfc497-9f42-4c55-9012-cc6501fe0dbb tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.242621 May 23 12:49:26.771779 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 125/228] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:26 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:26.820789 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b7a2f23a-b4bc-47f0-ab09-9586def34c0d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:26.831217 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b7a2f23a-b4bc-47f0-ab09-9586def34c0d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1218 microversion: 2.1 time: 0.101719 May 23 12:49:26.832454 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 104/229] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:26 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:27.073372 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e9e05d04-38be-4601-b078-b5a31c062687 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:27.074810 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e9e05d04-38be-4601-b078-b5a31c062687 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:27.086787 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9e05d04-38be-4601-b078-b5a31c062687 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:27.095557 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9e05d04-38be-4601-b078-b5a31c062687 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:27.096764 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9e05d04-38be-4601-b078-b5a31c062687 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:27.097393 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9e05d04-38be-4601-b078-b5a31c062687 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:27.186867 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-3a6074a9-b19f-410e-9d72-7e1b28d4cf06 req-9f3122f4-c6f5-41ea-86d6-9e0ab2542e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cc8749-8ab7-419e-8111-8b59e8cdf451", "tag": "6c41b3cd-02e2-44a8-9a11-b6a709f9a966"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:27.205186 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-3a6074a9-b19f-410e-9d72-7e1b28d4cf06 req-9f3122f4-c6f5-41ea-86d6-9e0ab2542e90 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:27.209101 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-3a6074a9-b19f-410e-9d72-7e1b28d4cf06 req-9f3122f4-c6f5-41ea-86d6-9e0ab2542e90 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:27.228935 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-3a6074a9-b19f-410e-9d72-7e1b28d4cf06 req-9f3122f4-c6f5-41ea-86d6-9e0ab2542e90 service nova] Creating event network-changed:6c41b3cd-02e2-44a8-9a11-b6a709f9a966 for instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 on hv-cinder-maste May 23 12:49:27.236503 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-3a6074a9-b19f-410e-9d72-7e1b28d4cf06 req-9f3122f4-c6f5-41ea-86d6-9e0ab2542e90 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055859 May 23 12:49:27.237371 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 105/230] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:49:27.242935 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-4d9a6e92-d2aa-48c2-b516-f8fac989511c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:27.243944 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-4d9a6e92-d2aa-48c2-b516-f8fac989511c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 972e71db-3655-4632-8a33-7d00caa402f5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:27.252999 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4d9a6e92-d2aa-48c2-b516-f8fac989511c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:27.253699 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4d9a6e92-d2aa-48c2-b516-f8fac989511c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:27.254735 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4d9a6e92-d2aa-48c2-b516-f8fac989511c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:27.255381 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4d9a6e92-d2aa-48c2-b516-f8fac989511c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:27.273629 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-4d9a6e92-d2aa-48c2-b516-f8fac989511c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] HTTP exception thrown: Instance 972e71db-3655-4632-8a33-7d00caa402f5 could not be found. May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-4d9a6e92-d2aa-48c2-b516-f8fac989511c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Request method failure captured: May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 HTTP/1.1 May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4LB77kvCYl6IER9LKu5Fjxuf1S_Ise0l5Xkq5ZQfvPhEndN8a0Iho_Buyl3i1BhgA_NNXg8sSaDbxBmI6rkf8uYbePzI0S_BGEBdAYCSF9hJmfmy3eEDfpGxn4z45K0ryfTdhggSvPVGDrKW1wuYwudAYZoIzAKLsat5pbwKWBOUKA May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: f894226ce03c4512a633fac4618d82b2 May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-VolumesActionsTest-1321270105 May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:49:27.276483 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f894226ce03c4512a633fac4618d82b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f894226ce03c4512a633fac4618d82b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f894226ce03c4512a633fac4618d82b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f894226ce03c4512a633fac4618d82b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-VolumesActionsTest-1321270105 May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: f894226ce03c4512a633fac4618d82b2 May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-VolumesActionsTest-1321270105 May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-VolumesActionsTest-1321270105-project May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: dfea4e573d5449e6943b8700424f556b May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-VolumesActionsTest-1321270105-project May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 972e71db-3655-4632-8a33-7d00caa402f5 could not be found. May 23 12:49:27.277665 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '972e71db-3655-4632-8a33-7d00caa402f5'} May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972e71db-3655-4632-8a33-7d00caa402f5 could not be found. May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:49:27.278333 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972e71db-3655-4632-8a33-7d00caa402f5 could not be found. May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972e71db-3655-4632-8a33-7d00caa402f5 could not be found. May 23 12:49:27.279419 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:49:27.282544 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-4d9a6e92-d2aa-48c2-b516-f8fac989511c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Returning 404 to user: Instance 972e71db-3655-4632-8a33-7d00caa402f5 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:49:27.283703 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-4d9a6e92-d2aa-48c2-b516-f8fac989511c tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5" status: 404 len: 111 microversion: 2.1 time: 0.044969 May 23 12:49:27.284525 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 106/231] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:27 2022] GET /compute/v2.1/servers/972e71db-3655-4632-8a33-7d00caa402f5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:49:27.330387 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e9e05d04-38be-4601-b078-b5a31c062687 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:27.340753 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e9e05d04-38be-4601-b078-b5a31c062687 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:27.342790 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e9e05d04-38be-4601-b078-b5a31c062687 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:27.344459 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e9e05d04-38be-4601-b078-b5a31c062687 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.276659 May 23 12:49:27.358469 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 126/232] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:27 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:27.455076 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-282610855", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "networks": [{"uuid": "72babcee-0278-49cc-a015-a5316fc87017"}]}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:27.487826 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b75575d5-b6cf-4b1d-8afa-39e86b473f74 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:27.488533 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b75575d5-b6cf-4b1d-8afa-39e86b473f74 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:27.495110 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b75575d5-b6cf-4b1d-8afa-39e86b473f74 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:27.495560 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b75575d5-b6cf-4b1d-8afa-39e86b473f74 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:27.496524 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b75575d5-b6cf-4b1d-8afa-39e86b473f74 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:27.496962 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b75575d5-b6cf-4b1d-8afa-39e86b473f74 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:27.531717 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] validate_networks() for [('72babcee-0278-49cc-a015-a5316fc87017', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:49:27.945316 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b75575d5-b6cf-4b1d-8afa-39e86b473f74 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:27.954145 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b75575d5-b6cf-4b1d-8afa-39e86b473f74 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1367 microversion: 2.1 time: 0.470335 May 23 12:49:27.954727 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 127/233] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:27 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:27.959618 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ab2f366c-0667-416e-8814-4dc0cc58cb46 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:27.960321 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ab2f366c-0667-416e-8814-4dc0cc58cb46 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:27.966915 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ab2f366c-0667-416e-8814-4dc0cc58cb46 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:27.967704 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ab2f366c-0667-416e-8814-4dc0cc58cb46 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:27.968530 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ab2f366c-0667-416e-8814-4dc0cc58cb46 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:27.969033 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ab2f366c-0667-416e-8814-4dc0cc58cb46 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:28.155063 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ab2f366c-0667-416e-8814-4dc0cc58cb46 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:28.164247 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ab2f366c-0667-416e-8814-4dc0cc58cb46 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.208025 May 23 12:49:28.174743 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 128/234] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:27 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:28.174743 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-bb8c6067-d9c9-4687-9885-25b894b21fa9 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:28.174743 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-bb8c6067-d9c9-4687-9885-25b894b21fa9 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:28.177512 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb8c6067-d9c9-4687-9885-25b894b21fa9 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:28.178037 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb8c6067-d9c9-4687-9885-25b894b21fa9 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:28.178848 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb8c6067-d9c9-4687-9885-25b894b21fa9 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:28.179358 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb8c6067-d9c9-4687-9885-25b894b21fa9 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:28.194103 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:49:28.194568 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:49:28.196073 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:49:28.196565 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:49:28.196988 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:49:28.209693 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:28.210996 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:28.211816 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:28.221272 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:28.249562 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-bb8c6067-d9c9-4687-9885-25b894b21fa9 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:28.253995 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Getting quotas for project f894226ce03c4512a633fac4618d82b2. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:49:28.258922 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Getting quotas for user dfea4e573d5449e6943b8700424f556b and project f894226ce03c4512a633fac4618d82b2. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:49:28.263484 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-bb8c6067-d9c9-4687-9885-25b894b21fa9 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1278 microversion: 2.1 time: 0.091622 May 23 12:49:28.264184 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 129/235] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:28 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:28.274189 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:49:28.277330 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:49:28.346329 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-920f191a-1aca-42e5-a781-ba98413f57a7 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895210 May 23 12:49:28.347294 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 107/236] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:49:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:49:28.358027 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5267faf3-d5a7-43ab-821a-a664d1717245 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:28.359601 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5267faf3-d5a7-43ab-821a-a664d1717245 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:28.374054 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f9da1431-01f2-42ab-90f1-f06552891b47 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:28.374806 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f9da1431-01f2-42ab-90f1-f06552891b47 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:28.391278 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f9da1431-01f2-42ab-90f1-f06552891b47 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:28.392984 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f9da1431-01f2-42ab-90f1-f06552891b47 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:28.394225 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f9da1431-01f2-42ab-90f1-f06552891b47 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:28.394820 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f9da1431-01f2-42ab-90f1-f06552891b47 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:28.428090 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5267faf3-d5a7-43ab-821a-a664d1717245 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:28.445847 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5267faf3-d5a7-43ab-821a-a664d1717245 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1213 microversion: 2.1 time: 0.092179 May 23 12:49:28.446627 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 130/237] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:28 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:28.559800 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f9da1431-01f2-42ab-90f1-f06552891b47 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:28.567759 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f9da1431-01f2-42ab-90f1-f06552891b47 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:28.569590 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f9da1431-01f2-42ab-90f1-f06552891b47 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:28.570953 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f9da1431-01f2-42ab-90f1-f06552891b47 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.209829 May 23 12:49:28.582808 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 108/238] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:28 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:28.972113 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2b1591bb-0d9f-4c52-a186-2b8dfb6c7e6b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:28.973016 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2b1591bb-0d9f-4c52-a186-2b8dfb6c7e6b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:28.980524 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2b1591bb-0d9f-4c52-a186-2b8dfb6c7e6b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:28.980974 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2b1591bb-0d9f-4c52-a186-2b8dfb6c7e6b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:28.981798 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2b1591bb-0d9f-4c52-a186-2b8dfb6c7e6b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:28.982392 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2b1591bb-0d9f-4c52-a186-2b8dfb6c7e6b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:29.183572 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5381a771-bb33-416e-af29-a63f61d1a2a8 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:29.185004 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5381a771-bb33-416e-af29-a63f61d1a2a8 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:29.201423 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5381a771-bb33-416e-af29-a63f61d1a2a8 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:29.202733 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5381a771-bb33-416e-af29-a63f61d1a2a8 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:29.207014 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5381a771-bb33-416e-af29-a63f61d1a2a8 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:29.207695 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5381a771-bb33-416e-af29-a63f61d1a2a8 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:29.283849 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2b1591bb-0d9f-4c52-a186-2b8dfb6c7e6b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:29.299976 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2b1591bb-0d9f-4c52-a186-2b8dfb6c7e6b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1367 microversion: 2.1 time: 0.332854 May 23 12:49:29.303656 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 131/239] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:28 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:29.341413 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2d453212-f1b0-43f9-8690-47f705d09683 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:29.344609 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2d453212-f1b0-43f9-8690-47f705d09683 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:29.377872 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2d453212-f1b0-43f9-8690-47f705d09683 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:29.378544 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2d453212-f1b0-43f9-8690-47f705d09683 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:29.382157 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2d453212-f1b0-43f9-8690-47f705d09683 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:29.383334 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2d453212-f1b0-43f9-8690-47f705d09683 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:29.429513 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5381a771-bb33-416e-af29-a63f61d1a2a8 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:29.437259 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5381a771-bb33-416e-af29-a63f61d1a2a8 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.258865 May 23 12:49:29.437830 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 109/240] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:29 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:29.464366 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b9e7e9ea-3137-4def-9fa0-a3e12e8cce8d tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:29.465785 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b9e7e9ea-3137-4def-9fa0-a3e12e8cce8d tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:29.467817 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2d453212-f1b0-43f9-8690-47f705d09683 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:29.473712 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b9e7e9ea-3137-4def-9fa0-a3e12e8cce8d tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:29.474276 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b9e7e9ea-3137-4def-9fa0-a3e12e8cce8d tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:29.475115 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b9e7e9ea-3137-4def-9fa0-a3e12e8cce8d tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:29.475382 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2d453212-f1b0-43f9-8690-47f705d09683 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1276 microversion: 2.1 time: 0.169382 May 23 12:49:29.475704 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b9e7e9ea-3137-4def-9fa0-a3e12e8cce8d tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:29.476206 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 132/241] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:29 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:29.542999 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b9e7e9ea-3137-4def-9fa0-a3e12e8cce8d tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:29.550492 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b9e7e9ea-3137-4def-9fa0-a3e12e8cce8d tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1265 microversion: 2.1 time: 0.090672 May 23 12:49:29.551065 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 110/242] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:29 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:29.591584 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3a786749-8513-41f9-94d4-6fdc17473c9e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:29.592201 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3a786749-8513-41f9-94d4-6fdc17473c9e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:29.598573 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3a786749-8513-41f9-94d4-6fdc17473c9e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:29.599083 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3a786749-8513-41f9-94d4-6fdc17473c9e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:29.599899 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3a786749-8513-41f9-94d4-6fdc17473c9e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:29.600410 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3a786749-8513-41f9-94d4-6fdc17473c9e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:29.824960 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3a786749-8513-41f9-94d4-6fdc17473c9e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:29.837684 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3a786749-8513-41f9-94d4-6fdc17473c9e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:29.840186 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3a786749-8513-41f9-94d4-6fdc17473c9e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:29.842200 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3a786749-8513-41f9-94d4-6fdc17473c9e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.255002 May 23 12:49:29.842948 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 133/243] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:29 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:30.319768 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a86a0f1a-c98f-47b1-8aac-3e04030444a8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:30.321103 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a86a0f1a-c98f-47b1-8aac-3e04030444a8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:30.329086 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a86a0f1a-c98f-47b1-8aac-3e04030444a8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:30.329569 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a86a0f1a-c98f-47b1-8aac-3e04030444a8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:30.330342 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a86a0f1a-c98f-47b1-8aac-3e04030444a8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:30.331036 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a86a0f1a-c98f-47b1-8aac-3e04030444a8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:30.474399 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ff031010-5369-45be-a57a-956de7b26895 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:30.476706 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ff031010-5369-45be-a57a-956de7b26895 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:30.493565 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ff031010-5369-45be-a57a-956de7b26895 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:30.493565 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ff031010-5369-45be-a57a-956de7b26895 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:30.493565 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ff031010-5369-45be-a57a-956de7b26895 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:30.493565 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ff031010-5369-45be-a57a-956de7b26895 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:30.495606 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a86a0f1a-c98f-47b1-8aac-3e04030444a8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:30.503502 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a86a0f1a-c98f-47b1-8aac-3e04030444a8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1367 microversion: 2.1 time: 0.187548 May 23 12:49:30.513942 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 111/244] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:30 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:30.513942 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c664aeb0-27c6-40be-9dcf-2b66f8caad2f tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:30.513942 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c664aeb0-27c6-40be-9dcf-2b66f8caad2f tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:30.518203 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c664aeb0-27c6-40be-9dcf-2b66f8caad2f tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:30.518631 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c664aeb0-27c6-40be-9dcf-2b66f8caad2f tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:30.520392 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c664aeb0-27c6-40be-9dcf-2b66f8caad2f tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:30.520392 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c664aeb0-27c6-40be-9dcf-2b66f8caad2f tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:30.717783 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c664aeb0-27c6-40be-9dcf-2b66f8caad2f tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:30.726071 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c664aeb0-27c6-40be-9dcf-2b66f8caad2f tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1318 microversion: 2.1 time: 0.220011 May 23 12:49:30.726722 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 112/245] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:30 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:30.732483 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ad4972df-80b3-418d-8ba7-d54606f41928 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:30.733078 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ad4972df-80b3-418d-8ba7-d54606f41928 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:30.739431 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad4972df-80b3-418d-8ba7-d54606f41928 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:30.739938 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad4972df-80b3-418d-8ba7-d54606f41928 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:30.740875 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad4972df-80b3-418d-8ba7-d54606f41928 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:30.741646 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad4972df-80b3-418d-8ba7-d54606f41928 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:30.821218 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ad4972df-80b3-418d-8ba7-d54606f41928 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:30.831939 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ad4972df-80b3-418d-8ba7-d54606f41928 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1271 microversion: 2.1 time: 0.103724 May 23 12:49:30.832528 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 113/246] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:30 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:30.875038 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6f5ade6c-d08d-48db-875d-28a39b0849da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:30.875644 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6f5ade6c-d08d-48db-875d-28a39b0849da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:30.882794 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6f5ade6c-d08d-48db-875d-28a39b0849da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:30.883188 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6f5ade6c-d08d-48db-875d-28a39b0849da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:30.883941 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6f5ade6c-d08d-48db-875d-28a39b0849da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:30.884373 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6f5ade6c-d08d-48db-875d-28a39b0849da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:30.901926 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ff031010-5369-45be-a57a-956de7b26895 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:30.912983 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ff031010-5369-45be-a57a-956de7b26895 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.461086 May 23 12:49:30.915496 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 134/247] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:30 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:31.052317 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6f5ade6c-d08d-48db-875d-28a39b0849da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:31.062256 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6f5ade6c-d08d-48db-875d-28a39b0849da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:31.063783 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6f5ade6c-d08d-48db-875d-28a39b0849da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:31.064949 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6f5ade6c-d08d-48db-875d-28a39b0849da tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.206748 May 23 12:49:31.065540 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 114/248] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:30 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:49:31.521287 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d0d186d0-55dd-4899-88bc-c2b7cbf8abf9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:31.522056 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d0d186d0-55dd-4899-88bc-c2b7cbf8abf9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:31.528886 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d0d186d0-55dd-4899-88bc-c2b7cbf8abf9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:31.529354 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d0d186d0-55dd-4899-88bc-c2b7cbf8abf9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:31.530128 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d0d186d0-55dd-4899-88bc-c2b7cbf8abf9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:31.530556 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d0d186d0-55dd-4899-88bc-c2b7cbf8abf9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:31.743773 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-801f9823-788a-49d1-83f1-7b1d5b2dcbb1 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:31.744526 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-801f9823-788a-49d1-83f1-7b1d5b2dcbb1 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:31.752783 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-801f9823-788a-49d1-83f1-7b1d5b2dcbb1 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:31.753748 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-801f9823-788a-49d1-83f1-7b1d5b2dcbb1 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:31.754650 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-801f9823-788a-49d1-83f1-7b1d5b2dcbb1 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:31.755596 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-801f9823-788a-49d1-83f1-7b1d5b2dcbb1 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:31.841436 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d0d186d0-55dd-4899-88bc-c2b7cbf8abf9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:31.874818 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d0d186d0-55dd-4899-88bc-c2b7cbf8abf9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1367 microversion: 2.1 time: 0.357244 May 23 12:49:31.891058 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 135/249] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:31 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:31.898095 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-de3c7f29-6106-4c73-bdc8-40c7767cc42a req-7a01dacc-d64a-4898-a13d-d8b85812720c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5c71c1d-673e-4a94-92c0-77b702758ea1", "tag": "3956c5ac-1ad4-4d9f-9012-f95e99abc437"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:31.914165 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-de3c7f29-6106-4c73-bdc8-40c7767cc42a req-7a01dacc-d64a-4898-a13d-d8b85812720c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:31.915103 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-de3c7f29-6106-4c73-bdc8-40c7767cc42a req-7a01dacc-d64a-4898-a13d-d8b85812720c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:31.955197 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-de3c7f29-6106-4c73-bdc8-40c7767cc42a req-7a01dacc-d64a-4898-a13d-d8b85812720c service nova] Creating event network-changed:3956c5ac-1ad4-4d9f-9012-f95e99abc437 for instance c5c71c1d-673e-4a94-92c0-77b702758ea1 on hv-cinder-maste May 23 12:49:31.964643 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-de3c7f29-6106-4c73-bdc8-40c7767cc42a req-7a01dacc-d64a-4898-a13d-d8b85812720c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069201 May 23 12:49:31.966113 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 136/250] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:31.976339 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-eb91785d-9fd6-4904-afe7-d3583302ff03 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:32.005018 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-eb91785d-9fd6-4904-afe7-d3583302ff03 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:32.016636 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-eb91785d-9fd6-4904-afe7-d3583302ff03 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:32.017001 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-eb91785d-9fd6-4904-afe7-d3583302ff03 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:32.017815 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-eb91785d-9fd6-4904-afe7-d3583302ff03 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:32.018239 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-eb91785d-9fd6-4904-afe7-d3583302ff03 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:32.043469 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=100 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:32.097378 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-801f9823-788a-49d1-83f1-7b1d5b2dcbb1 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:32.110723 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-801f9823-788a-49d1-83f1-7b1d5b2dcbb1 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1318 microversion: 2.1 time: 0.370912 May 23 12:49:32.111915 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 115/251] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:31 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:32.117920 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-920fe6af-a5dd-4497-b6e3-66f8ded5e599 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:32.120149 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-920fe6af-a5dd-4497-b6e3-66f8ded5e599 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:32.126810 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-920fe6af-a5dd-4497-b6e3-66f8ded5e599 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:32.127860 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-920fe6af-a5dd-4497-b6e3-66f8ded5e599 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:32.129910 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-920fe6af-a5dd-4497-b6e3-66f8ded5e599 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:32.130769 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-920fe6af-a5dd-4497-b6e3-66f8ded5e599 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:32.320162 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-920fe6af-a5dd-4497-b6e3-66f8ded5e599 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:32.330084 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-920fe6af-a5dd-4497-b6e3-66f8ded5e599 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.216857 May 23 12:49:32.331243 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 116/252] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:32 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:32.335569 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e4136a36-2962-451a-a5cb-98d08d66eeb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:32.336796 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e4136a36-2962-451a-a5cb-98d08d66eeb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:32.348550 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e4136a36-2962-451a-a5cb-98d08d66eeb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:32.357861 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e4136a36-2962-451a-a5cb-98d08d66eeb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:32.358759 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e4136a36-2962-451a-a5cb-98d08d66eeb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:32.359125 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e4136a36-2962-451a-a5cb-98d08d66eeb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:32.534504 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-eb91785d-9fd6-4904-afe7-d3583302ff03 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:32.554774 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-eb91785d-9fd6-4904-afe7-d3583302ff03 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.579413 May 23 12:49:32.554774 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 137/253] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:31 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:32.629480 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e4136a36-2962-451a-a5cb-98d08d66eeb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:32.642087 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e4136a36-2962-451a-a5cb-98d08d66eeb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:32.644012 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e4136a36-2962-451a-a5cb-98d08d66eeb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:32.645739 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e4136a36-2962-451a-a5cb-98d08d66eeb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.313539 May 23 12:49:32.647347 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 117/254] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:32 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:32.892081 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6b5a822e-9708-44cf-8c64-cf579199cf63 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:32.892663 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6b5a822e-9708-44cf-8c64-cf579199cf63 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:32.898709 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6b5a822e-9708-44cf-8c64-cf579199cf63 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:32.899192 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6b5a822e-9708-44cf-8c64-cf579199cf63 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:32.900266 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6b5a822e-9708-44cf-8c64-cf579199cf63 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:32.901444 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6b5a822e-9708-44cf-8c64-cf579199cf63 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:33.113599 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6b5a822e-9708-44cf-8c64-cf579199cf63 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:33.121536 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6b5a822e-9708-44cf-8c64-cf579199cf63 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1367 microversion: 2.1 time: 0.233489 May 23 12:49:33.122110 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 138/255] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:32 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:33.127665 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-72a7df8c-282a-436d-b5c9-1616bdfbf3f0 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:33.128353 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-72a7df8c-282a-436d-b5c9-1616bdfbf3f0 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:33.135486 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-72a7df8c-282a-436d-b5c9-1616bdfbf3f0 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:33.135928 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-72a7df8c-282a-436d-b5c9-1616bdfbf3f0 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:33.136684 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-72a7df8c-282a-436d-b5c9-1616bdfbf3f0 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:33.137114 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-72a7df8c-282a-436d-b5c9-1616bdfbf3f0 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:33.265029 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-72a7df8c-282a-436d-b5c9-1616bdfbf3f0 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:33.272357 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-72a7df8c-282a-436d-b5c9-1616bdfbf3f0 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1318 microversion: 2.1 time: 0.148549 May 23 12:49:33.272915 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 118/256] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:33 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:33.347890 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3ab9e4bd-f174-40e7-945f-9d87998537ed tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:33.348521 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3ab9e4bd-f174-40e7-945f-9d87998537ed tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:33.355267 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ab9e4bd-f174-40e7-945f-9d87998537ed tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:33.355704 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ab9e4bd-f174-40e7-945f-9d87998537ed tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:33.356457 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ab9e4bd-f174-40e7-945f-9d87998537ed tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:33.356882 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ab9e4bd-f174-40e7-945f-9d87998537ed tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:33.484796 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3ab9e4bd-f174-40e7-945f-9d87998537ed tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:33.492144 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3ab9e4bd-f174-40e7-945f-9d87998537ed tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.148072 May 23 12:49:33.492707 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 139/257] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:33 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:33.574224 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c760bca6-1305-4e48-ac04-7c745bf610a4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:33.574852 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c760bca6-1305-4e48-ac04-7c745bf610a4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:33.580740 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c760bca6-1305-4e48-ac04-7c745bf610a4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:33.581200 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c760bca6-1305-4e48-ac04-7c745bf610a4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:33.581941 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c760bca6-1305-4e48-ac04-7c745bf610a4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:33.582391 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c760bca6-1305-4e48-ac04-7c745bf610a4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:33.667408 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-10b48c45-9dcd-4453-9cd7-ded60f66ae95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:33.668101 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-10b48c45-9dcd-4453-9cd7-ded60f66ae95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:33.674313 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-10b48c45-9dcd-4453-9cd7-ded60f66ae95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:33.674933 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-10b48c45-9dcd-4453-9cd7-ded60f66ae95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:33.676102 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-10b48c45-9dcd-4453-9cd7-ded60f66ae95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:33.676271 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-10b48c45-9dcd-4453-9cd7-ded60f66ae95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:33.722535 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c760bca6-1305-4e48-ac04-7c745bf610a4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:33.736411 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c760bca6-1305-4e48-ac04-7c745bf610a4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.166217 May 23 12:49:33.736991 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 119/258] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:33 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:33.910929 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-10b48c45-9dcd-4453-9cd7-ded60f66ae95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:33.922650 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-10b48c45-9dcd-4453-9cd7-ded60f66ae95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:33.924767 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-10b48c45-9dcd-4453-9cd7-ded60f66ae95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:33.926592 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-10b48c45-9dcd-4453-9cd7-ded60f66ae95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.263619 May 23 12:49:33.927273 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 140/259] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:33 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:49:33.989039 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-4d4f2849-2701-47f6-9dd3-f3b30a70c72b req-9d6f65f2-57b6-4c8d-af7a-0159df8fc0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d568a7b-367e-4091-b0cc-b2cb9b01a74e", "tag": "8be1a3a4-7578-4444-a05d-08cc31bef763"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:33.999316 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-4d4f2849-2701-47f6-9dd3-f3b30a70c72b req-9d6f65f2-57b6-4c8d-af7a-0159df8fc0cf service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:33.999857 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-4d4f2849-2701-47f6-9dd3-f3b30a70c72b req-9d6f65f2-57b6-4c8d-af7a-0159df8fc0cf service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.013815 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-4d4f2849-2701-47f6-9dd3-f3b30a70c72b req-9d6f65f2-57b6-4c8d-af7a-0159df8fc0cf service nova] Creating event network-changed:8be1a3a4-7578-4444-a05d-08cc31bef763 for instance 6d568a7b-367e-4091-b0cc-b2cb9b01a74e on hv-cinder-maste May 23 12:49:34.022098 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-4d4f2849-2701-47f6-9dd3-f3b30a70c72b req-9d6f65f2-57b6-4c8d-af7a-0159df8fc0cf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036235 May 23 12:49:34.023363 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 120/260] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:34.138731 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-087337b6-11ef-47ee-b9a2-1bf89641d9db tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:34.139484 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-087337b6-11ef-47ee-b9a2-1bf89641d9db tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:34.146013 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-087337b6-11ef-47ee-b9a2-1bf89641d9db tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.146698 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-087337b6-11ef-47ee-b9a2-1bf89641d9db tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.147460 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-087337b6-11ef-47ee-b9a2-1bf89641d9db tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.147893 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-087337b6-11ef-47ee-b9a2-1bf89641d9db tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.167454 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-9f0c45c4-91eb-4c24-90d2-caaba68366cd req-a0f17bf8-180d-4675-b9e0-cf7bebe5fb89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cc8749-8ab7-419e-8111-8b59e8cdf451", "name": "network-vif-plugged", "status": "completed", "tag": "6c41b3cd-02e2-44a8-9a11-b6a709f9a966"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:34.185076 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-9f0c45c4-91eb-4c24-90d2-caaba68366cd req-a0f17bf8-180d-4675-b9e0-cf7bebe5fb89 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.185923 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-9f0c45c4-91eb-4c24-90d2-caaba68366cd req-a0f17bf8-180d-4675-b9e0-cf7bebe5fb89 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.199211 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-9f0c45c4-91eb-4c24-90d2-caaba68366cd req-a0f17bf8-180d-4675-b9e0-cf7bebe5fb89 service nova] Creating event network-vif-plugged:6c41b3cd-02e2-44a8-9a11-b6a709f9a966 for instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 on hv-cinder-maste May 23 12:49:34.205096 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-9f0c45c4-91eb-4c24-90d2-caaba68366cd req-a0f17bf8-180d-4675-b9e0-cf7bebe5fb89 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042411 May 23 12:49:34.206267 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 121/261] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:49:34.296664 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e994850c-c8ac-4144-b337-1b9ca7d59264 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:34.299144 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e994850c-c8ac-4144-b337-1b9ca7d59264 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:34.309168 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e994850c-c8ac-4144-b337-1b9ca7d59264 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.309869 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e994850c-c8ac-4144-b337-1b9ca7d59264 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.311647 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e994850c-c8ac-4144-b337-1b9ca7d59264 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.312508 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e994850c-c8ac-4144-b337-1b9ca7d59264 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.322715 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=100 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:34.560522 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-087337b6-11ef-47ee-b9a2-1bf89641d9db tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:34.568411 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-087337b6-11ef-47ee-b9a2-1bf89641d9db tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1367 microversion: 2.1 time: 0.433903 May 23 12:49:34.577967 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 141/262] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:34 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1367 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:34.583230 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-132882cd-46fa-4d71-aea2-2a71eab321e7 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:34.583827 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-132882cd-46fa-4d71-aea2-2a71eab321e7 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:34.590739 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-132882cd-46fa-4d71-aea2-2a71eab321e7 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.591412 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-132882cd-46fa-4d71-aea2-2a71eab321e7 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.592637 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-132882cd-46fa-4d71-aea2-2a71eab321e7 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.593258 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-132882cd-46fa-4d71-aea2-2a71eab321e7 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.677634 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e994850c-c8ac-4144-b337-1b9ca7d59264 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:34.686077 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e994850c-c8ac-4144-b337-1b9ca7d59264 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1318 microversion: 2.1 time: 0.400015 May 23 12:49:34.686732 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 122/263] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:34 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:34.754437 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7316fc88-c042-4589-9cbc-950cb9a0c460 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:34.755041 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7316fc88-c042-4589-9cbc-950cb9a0c460 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:34.761990 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7316fc88-c042-4589-9cbc-950cb9a0c460 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.762436 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7316fc88-c042-4589-9cbc-950cb9a0c460 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.763199 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7316fc88-c042-4589-9cbc-950cb9a0c460 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.763636 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7316fc88-c042-4589-9cbc-950cb9a0c460 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.823115 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-132882cd-46fa-4d71-aea2-2a71eab321e7 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:34.830635 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-132882cd-46fa-4d71-aea2-2a71eab321e7 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.251359 May 23 12:49:34.831214 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 142/264] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:34 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:34.896242 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7316fc88-c042-4589-9cbc-950cb9a0c460 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:34.904250 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7316fc88-c042-4589-9cbc-950cb9a0c460 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.153579 May 23 12:49:34.905083 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 123/265] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:34 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:34.945198 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e9a1a63c-98c3-4383-8e6e-d00f7678d653 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:34.945803 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e9a1a63c-98c3-4383-8e6e-d00f7678d653 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:34.952612 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9a1a63c-98c3-4383-8e6e-d00f7678d653 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.953050 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9a1a63c-98c3-4383-8e6e-d00f7678d653 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:34.954789 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9a1a63c-98c3-4383-8e6e-d00f7678d653 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:34.955235 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9a1a63c-98c3-4383-8e6e-d00f7678d653 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:35.234395 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e9a1a63c-98c3-4383-8e6e-d00f7678d653 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:35.242365 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e9a1a63c-98c3-4383-8e6e-d00f7678d653 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:35.243861 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e9a1a63c-98c3-4383-8e6e-d00f7678d653 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:35.245827 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e9a1a63c-98c3-4383-8e6e-d00f7678d653 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1745 microversion: 2.20 time: 0.304647 May 23 12:49:35.246389 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 143/266] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:34 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1745 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:35.585440 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b6587599-0ce2-46c4-a8f7-ea50ca9c217d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:35.586046 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b6587599-0ce2-46c4-a8f7-ea50ca9c217d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:35.594906 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b6587599-0ce2-46c4-a8f7-ea50ca9c217d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:35.595348 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b6587599-0ce2-46c4-a8f7-ea50ca9c217d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:35.599774 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b6587599-0ce2-46c4-a8f7-ea50ca9c217d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:35.600211 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b6587599-0ce2-46c4-a8f7-ea50ca9c217d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:35.703300 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1d37adc6-2c92-47a8-a81d-90af8d8f4580 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:35.704018 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1d37adc6-2c92-47a8-a81d-90af8d8f4580 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:35.710154 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1d37adc6-2c92-47a8-a81d-90af8d8f4580 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:35.710677 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1d37adc6-2c92-47a8-a81d-90af8d8f4580 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:35.711429 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1d37adc6-2c92-47a8-a81d-90af8d8f4580 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:35.711857 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1d37adc6-2c92-47a8-a81d-90af8d8f4580 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:35.855486 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1d37adc6-2c92-47a8-a81d-90af8d8f4580 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:35.863220 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1d37adc6-2c92-47a8-a81d-90af8d8f4580 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1318 microversion: 2.1 time: 0.163735 May 23 12:49:35.863804 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 144/267] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:35 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:35.868736 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b294dca1-2b18-4e3e-a283-96f0451ab2ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:35.869420 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b294dca1-2b18-4e3e-a283-96f0451ab2ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:35.876662 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b294dca1-2b18-4e3e-a283-96f0451ab2ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:35.877391 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b294dca1-2b18-4e3e-a283-96f0451ab2ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:35.878364 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b294dca1-2b18-4e3e-a283-96f0451ab2ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:35.878949 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b294dca1-2b18-4e3e-a283-96f0451ab2ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:36.029514 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b294dca1-2b18-4e3e-a283-96f0451ab2ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:36.041302 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b294dca1-2b18-4e3e-a283-96f0451ab2ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.176043 May 23 12:49:36.042174 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b6587599-0ce2-46c4-a8f7-ea50ca9c217d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:36.052979 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b6587599-0ce2-46c4-a8f7-ea50ca9c217d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1367 microversion: 2.1 time: 0.470465 May 23 12:49:36.053740 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 145/268] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:35 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:36.054540 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 124/269] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:35 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:36.061186 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2cc4ef46-0825-463b-9a6f-aefc7b4f3ccb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:36.062035 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2cc4ef46-0825-463b-9a6f-aefc7b4f3ccb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:36.068418 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2cc4ef46-0825-463b-9a6f-aefc7b4f3ccb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:36.068862 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2cc4ef46-0825-463b-9a6f-aefc7b4f3ccb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:36.069823 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2cc4ef46-0825-463b-9a6f-aefc7b4f3ccb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:36.070248 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2cc4ef46-0825-463b-9a6f-aefc7b4f3ccb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:36.264782 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-80616001-3983-4d2f-8799-4077d799b9d8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:36.265581 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-80616001-3983-4d2f-8799-4077d799b9d8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:36.272118 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-80616001-3983-4d2f-8799-4077d799b9d8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:36.272642 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-80616001-3983-4d2f-8799-4077d799b9d8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:36.273702 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-80616001-3983-4d2f-8799-4077d799b9d8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:36.274207 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-80616001-3983-4d2f-8799-4077d799b9d8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:36.277842 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2cc4ef46-0825-463b-9a6f-aefc7b4f3ccb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:36.285282 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2cc4ef46-0825-463b-9a6f-aefc7b4f3ccb tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.229573 May 23 12:49:36.286142 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 125/270] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:36 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:36.475956 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-80616001-3983-4d2f-8799-4077d799b9d8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:36.484809 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-80616001-3983-4d2f-8799-4077d799b9d8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:36.486486 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-80616001-3983-4d2f-8799-4077d799b9d8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:36.487751 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-80616001-3983-4d2f-8799-4077d799b9d8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1745 microversion: 2.20 time: 0.227444 May 23 12:49:36.488561 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 146/271] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:36 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1745 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:36.880288 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e5eadde1-65cf-4fd7-aa62-918f2353658c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:36.880897 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e5eadde1-65cf-4fd7-aa62-918f2353658c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:36.888099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e5eadde1-65cf-4fd7-aa62-918f2353658c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:36.888550 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e5eadde1-65cf-4fd7-aa62-918f2353658c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:36.889460 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e5eadde1-65cf-4fd7-aa62-918f2353658c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:36.890060 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e5eadde1-65cf-4fd7-aa62-918f2353658c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:37.045160 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e5eadde1-65cf-4fd7-aa62-918f2353658c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:37.052643 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e5eadde1-65cf-4fd7-aa62-918f2353658c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1318 microversion: 2.1 time: 0.176156 May 23 12:49:37.059552 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c7d1b57f-9d97-4047-b22c-5f7d0a64bab0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:37.060727 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c7d1b57f-9d97-4047-b22c-5f7d0a64bab0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:37.063083 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 126/272] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:36 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:37.074202 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-787de0a6-f951-4d7f-a0a6-8bd690c14d45 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:37.074896 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-787de0a6-f951-4d7f-a0a6-8bd690c14d45 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:37.076383 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c7d1b57f-9d97-4047-b22c-5f7d0a64bab0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:37.078151 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c7d1b57f-9d97-4047-b22c-5f7d0a64bab0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:37.080627 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c7d1b57f-9d97-4047-b22c-5f7d0a64bab0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:37.081264 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-787de0a6-f951-4d7f-a0a6-8bd690c14d45 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:37.081768 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-787de0a6-f951-4d7f-a0a6-8bd690c14d45 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:37.082748 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-787de0a6-f951-4d7f-a0a6-8bd690c14d45 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:37.083361 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-787de0a6-f951-4d7f-a0a6-8bd690c14d45 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:37.083562 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c7d1b57f-9d97-4047-b22c-5f7d0a64bab0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:37.288385 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-787de0a6-f951-4d7f-a0a6-8bd690c14d45 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:37.297452 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-787de0a6-f951-4d7f-a0a6-8bd690c14d45 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1367 microversion: 2.1 time: 0.227815 May 23 12:49:37.297942 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 127/273] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:37 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:37.302412 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d64f086a-d723-4e17-aa6a-9d3703affdb0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:37.303016 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d64f086a-d723-4e17-aa6a-9d3703affdb0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:37.309122 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d64f086a-d723-4e17-aa6a-9d3703affdb0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:37.309636 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d64f086a-d723-4e17-aa6a-9d3703affdb0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:37.310401 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d64f086a-d723-4e17-aa6a-9d3703affdb0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:37.310829 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d64f086a-d723-4e17-aa6a-9d3703affdb0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:37.377626 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c7d1b57f-9d97-4047-b22c-5f7d0a64bab0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:37.390930 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c7d1b57f-9d97-4047-b22c-5f7d0a64bab0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.335683 May 23 12:49:37.401275 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 147/274] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:37 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:37.494100 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d64f086a-d723-4e17-aa6a-9d3703affdb0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:37.506912 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-92f96b21-0b71-413c-88c8-321e6ae703e1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:37.507739 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-92f96b21-0b71-413c-88c8-321e6ae703e1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:37.510879 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d64f086a-d723-4e17-aa6a-9d3703affdb0 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.211808 May 23 12:49:37.511594 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 128/275] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:37 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:37.514804 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92f96b21-0b71-413c-88c8-321e6ae703e1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:37.515244 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92f96b21-0b71-413c-88c8-321e6ae703e1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:37.515996 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92f96b21-0b71-413c-88c8-321e6ae703e1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:37.516590 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92f96b21-0b71-413c-88c8-321e6ae703e1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:37.928785 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-92f96b21-0b71-413c-88c8-321e6ae703e1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:37.940680 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-92f96b21-0b71-413c-88c8-321e6ae703e1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:37.942849 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-92f96b21-0b71-413c-88c8-321e6ae703e1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:37.944057 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-92f96b21-0b71-413c-88c8-321e6ae703e1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1745 microversion: 2.20 time: 0.441025 May 23 12:49:37.955574 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 148/276] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:37 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1745 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:38.071330 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b800b26e-e202-4036-a607-cc8f2a012586 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:38.072268 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b800b26e-e202-4036-a607-cc8f2a012586 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:38.080170 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b800b26e-e202-4036-a607-cc8f2a012586 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.080703 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b800b26e-e202-4036-a607-cc8f2a012586 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.081707 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b800b26e-e202-4036-a607-cc8f2a012586 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.082344 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b800b26e-e202-4036-a607-cc8f2a012586 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.220775 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-4e2992ce-7826-4f85-8d25-a086588c7837 req-0765edf5-6e80-4408-90c6-6aeb696a6ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5c71c1d-673e-4a94-92c0-77b702758ea1", "name": "network-vif-plugged", "status": "completed", "tag": "3956c5ac-1ad4-4d9f-9012-f95e99abc437"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:38.238959 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-4e2992ce-7826-4f85-8d25-a086588c7837 req-0765edf5-6e80-4408-90c6-6aeb696a6ef6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.241416 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-4e2992ce-7826-4f85-8d25-a086588c7837 req-0765edf5-6e80-4408-90c6-6aeb696a6ef6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.241567 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=6 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:38.269643 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=22 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:38.279052 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b800b26e-e202-4036-a607-cc8f2a012586 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:38.280793 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-4e2992ce-7826-4f85-8d25-a086588c7837 req-0765edf5-6e80-4408-90c6-6aeb696a6ef6 service nova] Creating event network-vif-plugged:3956c5ac-1ad4-4d9f-9012-f95e99abc437 for instance c5c71c1d-673e-4a94-92c0-77b702758ea1 on hv-cinder-maste May 23 12:49:38.289243 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b800b26e-e202-4036-a607-cc8f2a012586 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1318 microversion: 2.1 time: 0.221886 May 23 12:49:38.299164 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 129/277] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:38 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:38.299355 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-4e2992ce-7826-4f85-8d25-a086588c7837 req-0765edf5-6e80-4408-90c6-6aeb696a6ef6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075419 May 23 12:49:38.299355 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 149/278] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:49:38.321058 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0efb2720-2d3a-4c20-91c2-22fc3a42632e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:38.321699 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0efb2720-2d3a-4c20-91c2-22fc3a42632e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:38.344247 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0efb2720-2d3a-4c20-91c2-22fc3a42632e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.346798 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0efb2720-2d3a-4c20-91c2-22fc3a42632e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.370187 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0efb2720-2d3a-4c20-91c2-22fc3a42632e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.370187 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0efb2720-2d3a-4c20-91c2-22fc3a42632e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.415616 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7a40f409-eb19-4153-9bda-bfcbd40d967e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:38.416348 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7a40f409-eb19-4153-9bda-bfcbd40d967e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:38.427199 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7a40f409-eb19-4153-9bda-bfcbd40d967e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.427654 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7a40f409-eb19-4153-9bda-bfcbd40d967e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.428431 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7a40f409-eb19-4153-9bda-bfcbd40d967e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.428936 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7a40f409-eb19-4153-9bda-bfcbd40d967e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.472941 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=6 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:38.672167 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0efb2720-2d3a-4c20-91c2-22fc3a42632e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:38.686948 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0efb2720-2d3a-4c20-91c2-22fc3a42632e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1557 microversion: 2.1 time: 0.375682 May 23 12:49:38.697738 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 130/279] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:38 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1557 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:38.707147 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8c1caeb5-a036-4a57-b22f-79ea52f13ff6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:38.707759 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8c1caeb5-a036-4a57-b22f-79ea52f13ff6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:38.730970 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c1caeb5-a036-4a57-b22f-79ea52f13ff6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.731416 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c1caeb5-a036-4a57-b22f-79ea52f13ff6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.732646 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c1caeb5-a036-4a57-b22f-79ea52f13ff6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.733461 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c1caeb5-a036-4a57-b22f-79ea52f13ff6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.786404 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7a40f409-eb19-4153-9bda-bfcbd40d967e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:38.798590 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7a40f409-eb19-4153-9bda-bfcbd40d967e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.388479 May 23 12:49:38.799734 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 150/280] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:38 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:38.813250 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3121c2ed-0281-42d4-88c2-f80400f4d477 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:38.814001 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3121c2ed-0281-42d4-88c2-f80400f4d477 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:38.821833 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3121c2ed-0281-42d4-88c2-f80400f4d477 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.823701 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3121c2ed-0281-42d4-88c2-f80400f4d477 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.824978 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3121c2ed-0281-42d4-88c2-f80400f4d477 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.825652 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3121c2ed-0281-42d4-88c2-f80400f4d477 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.903563 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8c1caeb5-a036-4a57-b22f-79ea52f13ff6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:38.913894 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8c1caeb5-a036-4a57-b22f-79ea52f13ff6 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.222010 May 23 12:49:38.916290 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 131/281] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:38 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:38.933076 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3121c2ed-0281-42d4-88c2-f80400f4d477 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131351 May 23 12:49:38.933893 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 151/282] 10.222.0.45 () {58 vars in 1274 bytes} [Mon May 23 12:49:38 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:38.962485 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-4cb208b2-3b69-48a6-bd5b-d83eae523b2c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:38.963775 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-4cb208b2-3b69-48a6-bd5b-d83eae523b2c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:38.971622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4cb208b2-3b69-48a6-bd5b-d83eae523b2c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.972170 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4cb208b2-3b69-48a6-bd5b-d83eae523b2c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:38.973085 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4cb208b2-3b69-48a6-bd5b-d83eae523b2c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:38.973604 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4cb208b2-3b69-48a6-bd5b-d83eae523b2c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:39.227043 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-4cb208b2-3b69-48a6-bd5b-d83eae523b2c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:39.237383 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-4cb208b2-3b69-48a6-bd5b-d83eae523b2c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:39.239131 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-4cb208b2-3b69-48a6-bd5b-d83eae523b2c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:39.240955 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-4cb208b2-3b69-48a6-bd5b-d83eae523b2c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.282119 May 23 12:49:39.242213 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 132/283] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:38 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:39.320829 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f68f12e9-e1e2-41fe-87cf-96597f21c5cd tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:39.322087 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f68f12e9-e1e2-41fe-87cf-96597f21c5cd tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:39.362091 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f68f12e9-e1e2-41fe-87cf-96597f21c5cd tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:39.363151 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f68f12e9-e1e2-41fe-87cf-96597f21c5cd tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:39.365901 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f68f12e9-e1e2-41fe-87cf-96597f21c5cd tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:39.366542 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f68f12e9-e1e2-41fe-87cf-96597f21c5cd tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:39.654464 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f68f12e9-e1e2-41fe-87cf-96597f21c5cd tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:39.674145 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f68f12e9-e1e2-41fe-87cf-96597f21c5cd tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1318 microversion: 2.1 time: 0.365098 May 23 12:49:39.688021 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 152/284] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:39 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:39.822023 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2088f39e-c990-4955-bd4e-5fdfc122bbf3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:39.823920 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2088f39e-c990-4955-bd4e-5fdfc122bbf3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:39.847479 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2088f39e-c990-4955-bd4e-5fdfc122bbf3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:39.847943 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2088f39e-c990-4955-bd4e-5fdfc122bbf3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:39.855680 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2088f39e-c990-4955-bd4e-5fdfc122bbf3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:39.856787 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2088f39e-c990-4955-bd4e-5fdfc122bbf3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:39.932493 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7655a9f0-2d98-4372-b0d1-6efb548ba313 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:39.933656 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7655a9f0-2d98-4372-b0d1-6efb548ba313 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:39.944397 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7655a9f0-2d98-4372-b0d1-6efb548ba313 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:39.945667 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7655a9f0-2d98-4372-b0d1-6efb548ba313 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:39.950133 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7655a9f0-2d98-4372-b0d1-6efb548ba313 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:39.951901 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7655a9f0-2d98-4372-b0d1-6efb548ba313 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:40.219954 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7655a9f0-2d98-4372-b0d1-6efb548ba313 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:40.241376 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7655a9f0-2d98-4372-b0d1-6efb548ba313 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.313237 May 23 12:49:40.242618 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 153/285] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:39 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:40.243763 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2088f39e-c990-4955-bd4e-5fdfc122bbf3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:40.264372 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2088f39e-c990-4955-bd4e-5fdfc122bbf3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.450222 May 23 12:49:40.267055 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 133/286] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:39 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:40.270667 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-48d86ba7-1148-4c85-9494-3b9ea10c68b0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:40.271536 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-48d86ba7-1148-4c85-9494-3b9ea10c68b0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:40.281621 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-48d86ba7-1148-4c85-9494-3b9ea10c68b0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:40.282392 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-48d86ba7-1148-4c85-9494-3b9ea10c68b0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:40.283431 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-48d86ba7-1148-4c85-9494-3b9ea10c68b0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:40.284091 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-48d86ba7-1148-4c85-9494-3b9ea10c68b0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:40.528125 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-9bef90d8-cf57-4050-9574-59aea1b72a7d req-6e3ce148-5a45-4392-8ffc-fa214adeb7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c365608-41a1-4663-b5e2-3481874a2325", "name": "network-vif-plugged", "status": "completed", "tag": "fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:40.557054 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-9bef90d8-cf57-4050-9574-59aea1b72a7d req-6e3ce148-5a45-4392-8ffc-fa214adeb7be service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:40.559041 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-9bef90d8-cf57-4050-9574-59aea1b72a7d req-6e3ce148-5a45-4392-8ffc-fa214adeb7be service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:40.586742 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-48d86ba7-1148-4c85-9494-3b9ea10c68b0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:40.602666 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-48d86ba7-1148-4c85-9494-3b9ea10c68b0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:40.612077 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-9bef90d8-cf57-4050-9574-59aea1b72a7d req-6e3ce148-5a45-4392-8ffc-fa214adeb7be service nova] Creating event network-vif-plugged:fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1 for instance 0c365608-41a1-4663-b5e2-3481874a2325 on hv-cinder-maste May 23 12:49:40.614546 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-48d86ba7-1148-4c85-9494-3b9ea10c68b0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:40.621079 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-48d86ba7-1148-4c85-9494-3b9ea10c68b0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.362003 May 23 12:49:40.623405 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 154/287] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:40 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:49:40.633428 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-9bef90d8-cf57-4050-9574-59aea1b72a7d req-6e3ce148-5a45-4392-8ffc-fa214adeb7be service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111574 May 23 12:49:40.638645 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 134/288] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:40.691047 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5beec7cd-585b-48d5-ad53-9166e911b713 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:40.691671 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5beec7cd-585b-48d5-ad53-9166e911b713 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:40.703815 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5beec7cd-585b-48d5-ad53-9166e911b713 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:40.704384 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5beec7cd-585b-48d5-ad53-9166e911b713 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:40.705040 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5beec7cd-585b-48d5-ad53-9166e911b713 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:40.705492 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5beec7cd-585b-48d5-ad53-9166e911b713 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:40.728021 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=100 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:40.779561 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-2e15789b-839d-4161-9134-e69a6ac9bfc6 req-408a06bc-05ec-4a55-a04c-a8c4f0e0cac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cc8749-8ab7-419e-8111-8b59e8cdf451", "tag": "6c41b3cd-02e2-44a8-9a11-b6a709f9a966"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:40.798264 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-2e15789b-839d-4161-9134-e69a6ac9bfc6 req-408a06bc-05ec-4a55-a04c-a8c4f0e0cac3 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:40.798747 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-2e15789b-839d-4161-9134-e69a6ac9bfc6 req-408a06bc-05ec-4a55-a04c-a8c4f0e0cac3 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:40.833794 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-2e15789b-839d-4161-9134-e69a6ac9bfc6 req-408a06bc-05ec-4a55-a04c-a8c4f0e0cac3 service nova] Creating event network-changed:6c41b3cd-02e2-44a8-9a11-b6a709f9a966 for instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 on hv-cinder-maste May 23 12:49:40.843289 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-2e15789b-839d-4161-9134-e69a6ac9bfc6 req-408a06bc-05ec-4a55-a04c-a8c4f0e0cac3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068935 May 23 12:49:40.843910 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 135/289] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:49:41.013030 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5beec7cd-585b-48d5-ad53-9166e911b713 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:41.021489 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5beec7cd-585b-48d5-ad53-9166e911b713 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1507 microversion: 2.1 time: 0.334488 May 23 12:49:41.023308 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 155/290] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:40 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:41.271407 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d30b46d2-8928-458f-bffd-30c3fc787d79 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:41.273830 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d30b46d2-8928-458f-bffd-30c3fc787d79 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:41.293244 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1a4a931e-c450-41c7-929d-49e02bd3e16b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:41.294700 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1a4a931e-c450-41c7-929d-49e02bd3e16b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:41.313661 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d30b46d2-8928-458f-bffd-30c3fc787d79 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:41.314348 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d30b46d2-8928-458f-bffd-30c3fc787d79 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:41.316443 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1a4a931e-c450-41c7-929d-49e02bd3e16b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:41.316921 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1a4a931e-c450-41c7-929d-49e02bd3e16b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:41.319594 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d30b46d2-8928-458f-bffd-30c3fc787d79 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:41.320098 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d30b46d2-8928-458f-bffd-30c3fc787d79 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:41.321212 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1a4a931e-c450-41c7-929d-49e02bd3e16b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:41.321655 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1a4a931e-c450-41c7-929d-49e02bd3e16b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:41.650977 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1a4a931e-c450-41c7-929d-49e02bd3e16b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:41.660456 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1a4a931e-c450-41c7-929d-49e02bd3e16b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.379341 May 23 12:49:41.661045 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 156/291] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:41 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:41.679063 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-508fe5a7-d225-4848-ae7e-b5ea70ef5b95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:41.679671 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-508fe5a7-d225-4848-ae7e-b5ea70ef5b95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:41.687220 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d30b46d2-8928-458f-bffd-30c3fc787d79 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:41.690317 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-508fe5a7-d225-4848-ae7e-b5ea70ef5b95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:41.690982 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-508fe5a7-d225-4848-ae7e-b5ea70ef5b95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:41.692058 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-508fe5a7-d225-4848-ae7e-b5ea70ef5b95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:41.692648 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-508fe5a7-d225-4848-ae7e-b5ea70ef5b95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:41.705072 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d30b46d2-8928-458f-bffd-30c3fc787d79 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.447496 May 23 12:49:41.710917 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 136/292] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:41 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:42.287343 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-508fe5a7-d225-4848-ae7e-b5ea70ef5b95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:42.302674 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-508fe5a7-d225-4848-ae7e-b5ea70ef5b95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:42.310310 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-508fe5a7-d225-4848-ae7e-b5ea70ef5b95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:42.311666 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-508fe5a7-d225-4848-ae7e-b5ea70ef5b95 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.645685 May 23 12:49:42.312328 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 157/293] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:41 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:42.685212 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-cdfc1d80-8f81-4519-9450-51aa3106f994 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:42.686083 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-cdfc1d80-8f81-4519-9450-51aa3106f994 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:42.700136 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-6f481ffd-df11-44a6-930a-baf0ba425469 req-dd8d2363-eb01-4d41-8492-5919c75660a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d568a7b-367e-4091-b0cc-b2cb9b01a74e", "name": "network-vif-plugged", "status": "completed", "tag": "8be1a3a4-7578-4444-a05d-08cc31bef763"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:42.714866 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cdfc1d80-8f81-4519-9450-51aa3106f994 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:42.715316 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cdfc1d80-8f81-4519-9450-51aa3106f994 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:42.716085 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cdfc1d80-8f81-4519-9450-51aa3106f994 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:42.716514 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cdfc1d80-8f81-4519-9450-51aa3106f994 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:42.720458 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-6f481ffd-df11-44a6-930a-baf0ba425469 req-dd8d2363-eb01-4d41-8492-5919c75660a2 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:42.722574 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-6f481ffd-df11-44a6-930a-baf0ba425469 req-dd8d2363-eb01-4d41-8492-5919c75660a2 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:42.743750 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-6f481ffd-df11-44a6-930a-baf0ba425469 req-dd8d2363-eb01-4d41-8492-5919c75660a2 service nova] Creating event network-vif-plugged:8be1a3a4-7578-4444-a05d-08cc31bef763 for instance 6d568a7b-367e-4091-b0cc-b2cb9b01a74e on hv-cinder-maste May 23 12:49:42.757437 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-6f481ffd-df11-44a6-930a-baf0ba425469 req-dd8d2363-eb01-4d41-8492-5919c75660a2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066078 May 23 12:49:42.758882 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 158/294] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:49:42.766525 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2cc6d2d4-66ca-4d50-9077-8f67f2fefccf tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:42.767359 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2cc6d2d4-66ca-4d50-9077-8f67f2fefccf tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:42.776088 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2cc6d2d4-66ca-4d50-9077-8f67f2fefccf tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:42.776696 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2cc6d2d4-66ca-4d50-9077-8f67f2fefccf tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:42.777997 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2cc6d2d4-66ca-4d50-9077-8f67f2fefccf tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:42.778671 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2cc6d2d4-66ca-4d50-9077-8f67f2fefccf tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:43.173729 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-cdfc1d80-8f81-4519-9450-51aa3106f994 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:43.194257 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-cdfc1d80-8f81-4519-9450-51aa3106f994 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1521 microversion: 2.1 time: 0.517145 May 23 12:49:43.201695 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2cc6d2d4-66ca-4d50-9077-8f67f2fefccf tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:43.210738 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2cc6d2d4-66ca-4d50-9077-8f67f2fefccf tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.450008 May 23 12:49:43.218483 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 137/295] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:42 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:43.222072 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 159/296] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:42 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:43.342662 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9b895168-f646-4dbe-a41e-8efd744d7493 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:43.344458 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9b895168-f646-4dbe-a41e-8efd744d7493 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:43.352410 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b895168-f646-4dbe-a41e-8efd744d7493 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:43.357423 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b895168-f646-4dbe-a41e-8efd744d7493 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:43.362100 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b895168-f646-4dbe-a41e-8efd744d7493 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:43.362717 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b895168-f646-4dbe-a41e-8efd744d7493 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:43.708340 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9b895168-f646-4dbe-a41e-8efd744d7493 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:43.716859 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9b895168-f646-4dbe-a41e-8efd744d7493 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:43.731320 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9b895168-f646-4dbe-a41e-8efd744d7493 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:43.732635 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9b895168-f646-4dbe-a41e-8efd744d7493 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.406348 May 23 12:49:43.743188 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 138/297] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:43 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:44.212777 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b57ed412-69bc-48eb-9eb2-7f35448c0c51 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:44.213479 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b57ed412-69bc-48eb-9eb2-7f35448c0c51 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:44.230621 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ac82201b-5645-45c2-91db-e5cc7b4891b4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:44.231497 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ac82201b-5645-45c2-91db-e5cc7b4891b4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:44.237528 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b57ed412-69bc-48eb-9eb2-7f35448c0c51 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:44.240695 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b57ed412-69bc-48eb-9eb2-7f35448c0c51 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:44.242483 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ac82201b-5645-45c2-91db-e5cc7b4891b4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:44.243666 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b57ed412-69bc-48eb-9eb2-7f35448c0c51 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:44.244910 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b57ed412-69bc-48eb-9eb2-7f35448c0c51 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:44.245757 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ac82201b-5645-45c2-91db-e5cc7b4891b4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:44.246750 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ac82201b-5645-45c2-91db-e5cc7b4891b4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:44.250586 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ac82201b-5645-45c2-91db-e5cc7b4891b4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:44.485504 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b57ed412-69bc-48eb-9eb2-7f35448c0c51 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:44.495761 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b57ed412-69bc-48eb-9eb2-7f35448c0c51 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1501 microversion: 2.1 time: 0.284887 May 23 12:49:44.496981 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 160/298] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:44 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1501 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:44.518159 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8caca51b-13a6-4a97-aa9b-0e2a6ccc4345 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:44.519004 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8caca51b-13a6-4a97-aa9b-0e2a6ccc4345 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:44.526482 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ac82201b-5645-45c2-91db-e5cc7b4891b4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:44.528320 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:44.531999 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8caca51b-13a6-4a97-aa9b-0e2a6ccc4345 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:44.532752 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8caca51b-13a6-4a97-aa9b-0e2a6ccc4345 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:44.533707 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8caca51b-13a6-4a97-aa9b-0e2a6ccc4345 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:44.534372 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8caca51b-13a6-4a97-aa9b-0e2a6ccc4345 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:44.536571 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ac82201b-5645-45c2-91db-e5cc7b4891b4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.310678 May 23 12:49:44.549347 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 139/299] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:44 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:44.752180 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f478903d-c5e7-44fc-b6a8-64522bf16711 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:44.754432 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f478903d-c5e7-44fc-b6a8-64522bf16711 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:44.767966 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f478903d-c5e7-44fc-b6a8-64522bf16711 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:44.769867 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f478903d-c5e7-44fc-b6a8-64522bf16711 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:44.773244 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f478903d-c5e7-44fc-b6a8-64522bf16711 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:44.775201 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f478903d-c5e7-44fc-b6a8-64522bf16711 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:44.839455 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=100 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:44.915215 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8caca51b-13a6-4a97-aa9b-0e2a6ccc4345 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:44.928774 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8caca51b-13a6-4a97-aa9b-0e2a6ccc4345 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1515 microversion: 2.1 time: 0.415548 May 23 12:49:44.930213 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 161/300] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:44 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1515 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:45.167421 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f478903d-c5e7-44fc-b6a8-64522bf16711 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:45.189218 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f478903d-c5e7-44fc-b6a8-64522bf16711 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:45.191692 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f478903d-c5e7-44fc-b6a8-64522bf16711 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:45.202908 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f478903d-c5e7-44fc-b6a8-64522bf16711 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.448760 May 23 12:49:45.205358 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 140/301] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:44 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:49:45.630342 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c349857e-6b9e-4186-871b-3c7bc28d3452 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:45.630342 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c349857e-6b9e-4186-871b-3c7bc28d3452 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:45.644973 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c349857e-6b9e-4186-871b-3c7bc28d3452 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:45.645458 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c349857e-6b9e-4186-871b-3c7bc28d3452 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:45.646278 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c349857e-6b9e-4186-871b-3c7bc28d3452 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:45.646769 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c349857e-6b9e-4186-871b-3c7bc28d3452 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:45.852033 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c349857e-6b9e-4186-871b-3c7bc28d3452 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:45.862418 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c349857e-6b9e-4186-871b-3c7bc28d3452 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1313 microversion: 2.1 time: 0.277910 May 23 12:49:45.863143 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 162/302] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:45 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:46.223470 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-dd310f62-9e5e-40f0-8bb6-7ee85717751b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:46.227433 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-dd310f62-9e5e-40f0-8bb6-7ee85717751b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:46.235734 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dd310f62-9e5e-40f0-8bb6-7ee85717751b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:46.236588 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dd310f62-9e5e-40f0-8bb6-7ee85717751b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:46.237686 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dd310f62-9e5e-40f0-8bb6-7ee85717751b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:46.238273 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dd310f62-9e5e-40f0-8bb6-7ee85717751b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:46.722585 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-dd310f62-9e5e-40f0-8bb6-7ee85717751b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:46.735190 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-dd310f62-9e5e-40f0-8bb6-7ee85717751b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:46.737182 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-dd310f62-9e5e-40f0-8bb6-7ee85717751b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:46.742198 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-dd310f62-9e5e-40f0-8bb6-7ee85717751b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.519022 May 23 12:49:46.754561 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 141/303] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:46 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:46.852415 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f67d37b4-ae04-4c74-9773-1dab9ed0454c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:46.854034 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f67d37b4-ae04-4c74-9773-1dab9ed0454c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:46.868882 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f67d37b4-ae04-4c74-9773-1dab9ed0454c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:46.872996 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f67d37b4-ae04-4c74-9773-1dab9ed0454c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:46.876002 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f67d37b4-ae04-4c74-9773-1dab9ed0454c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:46.876625 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f67d37b4-ae04-4c74-9773-1dab9ed0454c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:46.885541 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-17f86ef0-cfcd-4968-b5e9-4c821985e963 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:46.889989 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-17f86ef0-cfcd-4968-b5e9-4c821985e963 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:46.902739 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17f86ef0-cfcd-4968-b5e9-4c821985e963 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:46.917668 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17f86ef0-cfcd-4968-b5e9-4c821985e963 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:46.918969 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17f86ef0-cfcd-4968-b5e9-4c821985e963 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:46.919784 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17f86ef0-cfcd-4968-b5e9-4c821985e963 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:46.961826 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-f67d37b4-ae04-4c74-9773-1dab9ed0454c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lazy-loading 'flavor' on Instance uuid 73837a44-cd22-4db0-a18c-ecd5f3ec8156 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:49:47.143458 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f67d37b4-ae04-4c74-9773-1dab9ed0454c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156/action" status: 200 len: 32 microversion: 2.1 time: 0.295336 May 23 12:49:47.152547 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 163/304] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:49:46 2022] POST /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156/action => generated 32 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:49:47.167000 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2c817346-c5b0-4d35-bdd6-5209739bccb2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:47.176676 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2c817346-c5b0-4d35-bdd6-5209739bccb2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:47.205503 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-17f86ef0-cfcd-4968-b5e9-4c821985e963 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:47.209850 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2c817346-c5b0-4d35-bdd6-5209739bccb2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:47.210429 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2c817346-c5b0-4d35-bdd6-5209739bccb2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:47.212641 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2c817346-c5b0-4d35-bdd6-5209739bccb2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:47.217779 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2c817346-c5b0-4d35-bdd6-5209739bccb2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:47.219431 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-17f86ef0-cfcd-4968-b5e9-4c821985e963 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1497 microversion: 2.1 time: 0.338834 May 23 12:49:47.221519 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 142/305] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:46 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1497 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:47.703272 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2c817346-c5b0-4d35-bdd6-5209739bccb2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:47.723636 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2c817346-c5b0-4d35-bdd6-5209739bccb2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.566767 May 23 12:49:47.731593 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 164/306] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:47 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:47.763273 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3d7c8d89-8eed-43c3-8a04-6c40f1da75f6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:47.764569 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3d7c8d89-8eed-43c3-8a04-6c40f1da75f6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:47.782003 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d7c8d89-8eed-43c3-8a04-6c40f1da75f6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:47.782791 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d7c8d89-8eed-43c3-8a04-6c40f1da75f6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:47.783865 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d7c8d89-8eed-43c3-8a04-6c40f1da75f6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:47.784515 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d7c8d89-8eed-43c3-8a04-6c40f1da75f6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:48.099657 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3d7c8d89-8eed-43c3-8a04-6c40f1da75f6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:48.111562 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3d7c8d89-8eed-43c3-8a04-6c40f1da75f6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:48.122117 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3d7c8d89-8eed-43c3-8a04-6c40f1da75f6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:48.123701 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3d7c8d89-8eed-43c3-8a04-6c40f1da75f6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.365326 May 23 12:49:48.124792 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 143/307] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:47 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:48.418035 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-45da3df1-f997-4367-854f-37219939dfa4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:48.419442 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-45da3df1-f997-4367-854f-37219939dfa4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:48.431928 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-45da3df1-f997-4367-854f-37219939dfa4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:48.433464 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-45da3df1-f997-4367-854f-37219939dfa4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:48.435007 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-45da3df1-f997-4367-854f-37219939dfa4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:48.435667 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-45da3df1-f997-4367-854f-37219939dfa4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:48.500275 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-45da3df1-f997-4367-854f-37219939dfa4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:49:48.700039 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-45da3df1-f997-4367-854f-37219939dfa4 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 204 len: 0 microversion: 2.1 time: 0.285489 May 23 12:49:48.702197 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 165/308] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:49:48 2022] DELETE /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:49:48.714343 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3d6a1ea6-7f52-46dc-98c4-0a9bb3a4c2ea tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:48.715145 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3d6a1ea6-7f52-46dc-98c4-0a9bb3a4c2ea tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:48.723267 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d6a1ea6-7f52-46dc-98c4-0a9bb3a4c2ea tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:48.723867 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d6a1ea6-7f52-46dc-98c4-0a9bb3a4c2ea tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:48.724796 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d6a1ea6-7f52-46dc-98c4-0a9bb3a4c2ea tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:48.725370 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d6a1ea6-7f52-46dc-98c4-0a9bb3a4c2ea tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:48.752183 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8c702b44-9593-4a73-b335-47b48bbe2096 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:48.753255 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8c702b44-9593-4a73-b335-47b48bbe2096 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:48.768924 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c702b44-9593-4a73-b335-47b48bbe2096 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:48.769801 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c702b44-9593-4a73-b335-47b48bbe2096 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:48.771941 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c702b44-9593-4a73-b335-47b48bbe2096 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:48.773435 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c702b44-9593-4a73-b335-47b48bbe2096 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:49.015772 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3d6a1ea6-7f52-46dc-98c4-0a9bb3a4c2ea tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:49.032285 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3d6a1ea6-7f52-46dc-98c4-0a9bb3a4c2ea tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1503 microversion: 2.1 time: 0.322989 May 23 12:49:49.033775 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 144/309] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:48 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:49:49.145973 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8e7998e0-c58c-49b0-affd-9a2a7facd03d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:49.146914 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8e7998e0-c58c-49b0-affd-9a2a7facd03d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:49.162288 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:49.185422 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8e7998e0-c58c-49b0-affd-9a2a7facd03d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:49.186075 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8e7998e0-c58c-49b0-affd-9a2a7facd03d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:49.188721 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8e7998e0-c58c-49b0-affd-9a2a7facd03d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:49.191457 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8e7998e0-c58c-49b0-affd-9a2a7facd03d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:49.415185 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8e7998e0-c58c-49b0-affd-9a2a7facd03d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:49.427452 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8c702b44-9593-4a73-b335-47b48bbe2096 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:49.434706 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8e7998e0-c58c-49b0-affd-9a2a7facd03d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:49.437311 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8e7998e0-c58c-49b0-affd-9a2a7facd03d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:49.437471 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8c702b44-9593-4a73-b335-47b48bbe2096 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.691947 May 23 12:49:49.439502 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8e7998e0-c58c-49b0-affd-9a2a7facd03d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.299353 May 23 12:49:49.440658 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 145/310] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:49 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:49.444227 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 166/311] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:48 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:50.053446 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-43ed8a47-62bb-48b2-b50d-1b110eefc850 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:50.054895 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-43ed8a47-62bb-48b2-b50d-1b110eefc850 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:50.081323 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-43ed8a47-62bb-48b2-b50d-1b110eefc850 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:50.082377 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-43ed8a47-62bb-48b2-b50d-1b110eefc850 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:50.083342 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-43ed8a47-62bb-48b2-b50d-1b110eefc850 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:50.086025 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-43ed8a47-62bb-48b2-b50d-1b110eefc850 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:50.339164 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-43ed8a47-62bb-48b2-b50d-1b110eefc850 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:50.347291 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-43ed8a47-62bb-48b2-b50d-1b110eefc850 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1503 microversion: 2.1 time: 0.300134 May 23 12:49:50.358910 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 146/312] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:50 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1503 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:50.472843 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-93992218-6ba6-4cec-910c-745a41769f3d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:50.473347 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-93992218-6ba6-4cec-910c-745a41769f3d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:50.476730 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b642ac65-5890-419b-8123-9e9db9676112 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:50.477972 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b642ac65-5890-419b-8123-9e9db9676112 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:50.489414 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b642ac65-5890-419b-8123-9e9db9676112 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:50.496045 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-93992218-6ba6-4cec-910c-745a41769f3d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:50.496485 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-93992218-6ba6-4cec-910c-745a41769f3d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:50.497857 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-93992218-6ba6-4cec-910c-745a41769f3d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:50.497857 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-93992218-6ba6-4cec-910c-745a41769f3d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:50.506075 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b642ac65-5890-419b-8123-9e9db9676112 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:50.507185 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b642ac65-5890-419b-8123-9e9db9676112 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:50.510371 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b642ac65-5890-419b-8123-9e9db9676112 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:50.724284 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-93992218-6ba6-4cec-910c-745a41769f3d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:50.737604 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-93992218-6ba6-4cec-910c-745a41769f3d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.270639 May 23 12:49:50.738189 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 147/313] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:50 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:50.972967 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b642ac65-5890-419b-8123-9e9db9676112 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:50.988547 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b642ac65-5890-419b-8123-9e9db9676112 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:50.991589 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b642ac65-5890-419b-8123-9e9db9676112 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:50.994450 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b642ac65-5890-419b-8123-9e9db9676112 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.525632 May 23 12:49:51.007716 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 167/314] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:50 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:51.367242 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-dea27d31-8c7d-40f3-823b-ee3376bf82d5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:51.367962 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-dea27d31-8c7d-40f3-823b-ee3376bf82d5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:51.379919 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dea27d31-8c7d-40f3-823b-ee3376bf82d5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:51.380746 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dea27d31-8c7d-40f3-823b-ee3376bf82d5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:51.383906 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dea27d31-8c7d-40f3-823b-ee3376bf82d5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:51.387021 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dea27d31-8c7d-40f3-823b-ee3376bf82d5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:51.755804 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-dea27d31-8c7d-40f3-823b-ee3376bf82d5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfea4e573d5449e6943b8700424f556b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f894226ce03c4512a633fac4618d82b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:51.761693 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-882bae09-2bf9-4223-984c-946bef6a721f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:51.765258 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-882bae09-2bf9-4223-984c-946bef6a721f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:51.777448 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-dea27d31-8c7d-40f3-823b-ee3376bf82d5 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 200 len: 1503 microversion: 2.1 time: 0.415929 May 23 12:49:51.778881 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-882bae09-2bf9-4223-984c-946bef6a721f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:51.779858 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 148/315] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:51 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 1503 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:51.780677 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-882bae09-2bf9-4223-984c-946bef6a721f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:51.781740 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-882bae09-2bf9-4223-984c-946bef6a721f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:51.782418 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-882bae09-2bf9-4223-984c-946bef6a721f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:51.956095 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-dfd0d600-0ce5-4fb5-aaeb-54647628d286 req-a34bf2f8-f1a8-4acd-b6ef-eb7c96fc4ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d568a7b-367e-4091-b0cc-b2cb9b01a74e", "name": "network-vif-deleted", "tag": "8be1a3a4-7578-4444-a05d-08cc31bef763"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:49:51.980628 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-dfd0d600-0ce5-4fb5-aaeb-54647628d286 req-a34bf2f8-f1a8-4acd-b6ef-eb7c96fc4ba4 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:51.981427 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-dfd0d600-0ce5-4fb5-aaeb-54647628d286 req-a34bf2f8-f1a8-4acd-b6ef-eb7c96fc4ba4 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:52.027361 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-dfd0d600-0ce5-4fb5-aaeb-54647628d286 req-a34bf2f8-f1a8-4acd-b6ef-eb7c96fc4ba4 service nova] Creating event network-vif-deleted:8be1a3a4-7578-4444-a05d-08cc31bef763 for instance 6d568a7b-367e-4091-b0cc-b2cb9b01a74e on hv-cinder-maste May 23 12:49:52.034737 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-dfd0d600-0ce5-4fb5-aaeb-54647628d286 req-a34bf2f8-f1a8-4acd-b6ef-eb7c96fc4ba4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083241 May 23 12:49:52.035992 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 149/316] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:49:52.042420 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-862679fe-761c-4900-bc9f-00c98e511510 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:52.043662 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-862679fe-761c-4900-bc9f-00c98e511510 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:52.051243 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-862679fe-761c-4900-bc9f-00c98e511510 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:52.052009 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-862679fe-761c-4900-bc9f-00c98e511510 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:52.053455 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-862679fe-761c-4900-bc9f-00c98e511510 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:52.054122 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-862679fe-761c-4900-bc9f-00c98e511510 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:52.226140 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-882bae09-2bf9-4223-984c-946bef6a721f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:52.231356 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:49:52.243253 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-882bae09-2bf9-4223-984c-946bef6a721f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.492271 May 23 12:49:52.246153 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 168/317] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:51 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:52.362451 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-862679fe-761c-4900-bc9f-00c98e511510 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:52.374659 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-862679fe-761c-4900-bc9f-00c98e511510 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:52.376882 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-862679fe-761c-4900-bc9f-00c98e511510 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:52.378290 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-862679fe-761c-4900-bc9f-00c98e511510 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.340744 May 23 12:49:52.379209 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 150/318] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:52 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:52.802226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3d5cac61-3bc0-4e03-aebc-9fab170239c2 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:52.802941 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3d5cac61-3bc0-4e03-aebc-9fab170239c2 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] [instance: 6d568a7b-367e-4091-b0cc-b2cb9b01a74e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:52.819232 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3d5cac61-3bc0-4e03-aebc-9fab170239c2 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:52.819679 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3d5cac61-3bc0-4e03-aebc-9fab170239c2 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:52.820450 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3d5cac61-3bc0-4e03-aebc-9fab170239c2 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:52.820879 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3d5cac61-3bc0-4e03-aebc-9fab170239c2 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:52.858457 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-3d5cac61-3bc0-4e03-aebc-9fab170239c2 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] HTTP exception thrown: Instance 6d568a7b-367e-4091-b0cc-b2cb9b01a74e could not be found. May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3d5cac61-3bc0-4e03-aebc-9fab170239c2 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Request method failure captured: May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e HTTP/1.1 May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4LB77kvCYl6IER9LKu5Fjxuf1S_Ise0l5Xkq5ZQfvPhEndN8a0Iho_Buyl3i1BhgA_NNXg8sSaDbxBmI6rkf8uYbePzI0S_BGEBdAYCSF9hJmfmy3eEDfpGxn4z45K0ryfTdhggSvPVGDrKW1wuYwudAYZoIzAKLsat5pbwKWBOUKA May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: f894226ce03c4512a633fac4618d82b2 May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesActionsTest-1321270105 May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:49:52.860129 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f894226ce03c4512a633fac4618d82b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f894226ce03c4512a633fac4618d82b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f894226ce03c4512a633fac4618d82b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f894226ce03c4512a633fac4618d82b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesActionsTest-1321270105 May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: f894226ce03c4512a633fac4618d82b2 May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesActionsTest-1321270105 May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesActionsTest-1321270105-project May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: dfea4e573d5449e6943b8700424f556b May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesActionsTest-1321270105-project May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance 6d568a7b-367e-4091-b0cc-b2cb9b01a74e could not be found. May 23 12:49:52.861536 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': '6d568a7b-367e-4091-b0cc-b2cb9b01a74e'} May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d568a7b-367e-4091-b0cc-b2cb9b01a74e could not be found. May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:49:52.862266 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d568a7b-367e-4091-b0cc-b2cb9b01a74e could not be found. May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d568a7b-367e-4091-b0cc-b2cb9b01a74e could not be found. May 23 12:49:52.863570 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:49:52.864701 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3d5cac61-3bc0-4e03-aebc-9fab170239c2 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] Returning 404 to user: Instance 6d568a7b-367e-4091-b0cc-b2cb9b01a74e could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:49:52.864701 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3d5cac61-3bc0-4e03-aebc-9fab170239c2 tempest-VolumesActionsTest-1321270105 tempest-VolumesActionsTest-1321270105-project] 10.222.0.45 "GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e" status: 404 len: 111 microversion: 2.1 time: 0.068281 May 23 12:49:52.893060 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 169/319] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:52 2022] GET /compute/v2.1/servers/6d568a7b-367e-4091-b0cc-b2cb9b01a74e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:49:53.263745 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1a74dcfd-3b89-4c8f-a215-4604d8a8eee2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:53.264676 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1a74dcfd-3b89-4c8f-a215-4604d8a8eee2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:53.271061 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1a74dcfd-3b89-4c8f-a215-4604d8a8eee2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:53.272032 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1a74dcfd-3b89-4c8f-a215-4604d8a8eee2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:53.273698 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1a74dcfd-3b89-4c8f-a215-4604d8a8eee2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:53.274343 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1a74dcfd-3b89-4c8f-a215-4604d8a8eee2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:53.400365 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c3048571-7287-489d-9980-15784be6e43a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:53.401364 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c3048571-7287-489d-9980-15784be6e43a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:53.410007 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3048571-7287-489d-9980-15784be6e43a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:53.410454 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3048571-7287-489d-9980-15784be6e43a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:53.415806 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3048571-7287-489d-9980-15784be6e43a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:53.422052 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c3048571-7287-489d-9980-15784be6e43a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:53.452326 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-1a74dcfd-3b89-4c8f-a215-4604d8a8eee2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:53.464296 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1a74dcfd-3b89-4c8f-a215-4604d8a8eee2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.205878 May 23 12:49:53.480929 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 151/320] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:53 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:53.764368 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c3048571-7287-489d-9980-15784be6e43a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:53.782037 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c3048571-7287-489d-9980-15784be6e43a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:53.783970 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c3048571-7287-489d-9980-15784be6e43a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:53.786016 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c3048571-7287-489d-9980-15784be6e43a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.389929 May 23 12:49:53.812214 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 170/321] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:53 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:54.484893 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-74a7cab6-7b9e-40d4-97f0-4534450fb77a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:54.485696 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-74a7cab6-7b9e-40d4-97f0-4534450fb77a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:54.499626 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-74a7cab6-7b9e-40d4-97f0-4534450fb77a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:54.500555 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-74a7cab6-7b9e-40d4-97f0-4534450fb77a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:54.502831 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-74a7cab6-7b9e-40d4-97f0-4534450fb77a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:54.502831 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-74a7cab6-7b9e-40d4-97f0-4534450fb77a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:54.752357 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-74a7cab6-7b9e-40d4-97f0-4534450fb77a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:54.768520 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-74a7cab6-7b9e-40d4-97f0-4534450fb77a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.288670 May 23 12:49:54.773257 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 152/322] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:54 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:54.811865 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-69912823-e629-4298-8f83-c52bbb8f369f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:54.813100 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-69912823-e629-4298-8f83-c52bbb8f369f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:54.842180 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-69912823-e629-4298-8f83-c52bbb8f369f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:54.843123 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-69912823-e629-4298-8f83-c52bbb8f369f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:54.846359 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-69912823-e629-4298-8f83-c52bbb8f369f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:54.848689 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-69912823-e629-4298-8f83-c52bbb8f369f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:55.120525 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-69912823-e629-4298-8f83-c52bbb8f369f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:55.131326 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-69912823-e629-4298-8f83-c52bbb8f369f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:55.133531 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-69912823-e629-4298-8f83-c52bbb8f369f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:55.135742 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-69912823-e629-4298-8f83-c52bbb8f369f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.329227 May 23 12:49:55.139363 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 171/323] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:54 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:55.789083 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7ade019e-e57c-4a6c-9188-33d638bf61d9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:55.789711 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7ade019e-e57c-4a6c-9188-33d638bf61d9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:55.801924 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7ade019e-e57c-4a6c-9188-33d638bf61d9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:55.802541 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7ade019e-e57c-4a6c-9188-33d638bf61d9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:55.805625 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7ade019e-e57c-4a6c-9188-33d638bf61d9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:55.806177 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7ade019e-e57c-4a6c-9188-33d638bf61d9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:56.074018 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7ade019e-e57c-4a6c-9188-33d638bf61d9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:56.087951 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7ade019e-e57c-4a6c-9188-33d638bf61d9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.302874 May 23 12:49:56.088534 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 153/324] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:55 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:56.156152 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d9453a09-fa85-413e-8c54-4832acd3a13a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:56.156757 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d9453a09-fa85-413e-8c54-4832acd3a13a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:56.166578 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d9453a09-fa85-413e-8c54-4832acd3a13a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:56.169185 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d9453a09-fa85-413e-8c54-4832acd3a13a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:56.170075 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d9453a09-fa85-413e-8c54-4832acd3a13a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:56.170559 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d9453a09-fa85-413e-8c54-4832acd3a13a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:56.511355 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d9453a09-fa85-413e-8c54-4832acd3a13a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:56.523487 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d9453a09-fa85-413e-8c54-4832acd3a13a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:56.525070 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d9453a09-fa85-413e-8c54-4832acd3a13a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:56.528712 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d9453a09-fa85-413e-8c54-4832acd3a13a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.376622 May 23 12:49:56.547662 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 172/325] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:56 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:57.118112 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-803b15cc-987b-4144-afa6-7962d0355bee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:57.119420 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-803b15cc-987b-4144-afa6-7962d0355bee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:57.136959 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-803b15cc-987b-4144-afa6-7962d0355bee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:57.137439 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-803b15cc-987b-4144-afa6-7962d0355bee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:57.154656 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-803b15cc-987b-4144-afa6-7962d0355bee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:57.155408 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-803b15cc-987b-4144-afa6-7962d0355bee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:57.556039 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a3c21046-8d1a-4b63-a49f-20f09cfa9772 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:57.564945 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a3c21046-8d1a-4b63-a49f-20f09cfa9772 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:57.595635 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a3c21046-8d1a-4b63-a49f-20f09cfa9772 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:57.596195 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a3c21046-8d1a-4b63-a49f-20f09cfa9772 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:57.597056 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a3c21046-8d1a-4b63-a49f-20f09cfa9772 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:57.597585 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a3c21046-8d1a-4b63-a49f-20f09cfa9772 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:57.980045 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a3c21046-8d1a-4b63-a49f-20f09cfa9772 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:58.014264 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a3c21046-8d1a-4b63-a49f-20f09cfa9772 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:58.022398 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a3c21046-8d1a-4b63-a49f-20f09cfa9772 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:58.028388 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a3c21046-8d1a-4b63-a49f-20f09cfa9772 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.482345 May 23 12:49:58.039440 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 173/326] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:57 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:58.560966 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-803b15cc-987b-4144-afa6-7962d0355bee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:58.572517 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-803b15cc-987b-4144-afa6-7962d0355bee tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 1.459451 May 23 12:49:58.573168 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 154/327] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:57 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:49:59.047721 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-18dc7e24-ce9f-4327-b7a7-2a8645ecfbc3 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:59.049536 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-18dc7e24-ce9f-4327-b7a7-2a8645ecfbc3 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:59.060417 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-18dc7e24-ce9f-4327-b7a7-2a8645ecfbc3 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:59.064501 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-18dc7e24-ce9f-4327-b7a7-2a8645ecfbc3 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:59.076272 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-18dc7e24-ce9f-4327-b7a7-2a8645ecfbc3 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:59.076970 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-18dc7e24-ce9f-4327-b7a7-2a8645ecfbc3 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:59.593568 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1d26982f-e1be-407a-8d11-b2b829cba104 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:49:59.594157 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1d26982f-e1be-407a-8d11-b2b829cba104 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:49:59.609082 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1d26982f-e1be-407a-8d11-b2b829cba104 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:59.609944 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1d26982f-e1be-407a-8d11-b2b829cba104 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:59.610986 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1d26982f-e1be-407a-8d11-b2b829cba104 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:49:59.611665 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1d26982f-e1be-407a-8d11-b2b829cba104 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:49:59.630791 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-18dc7e24-ce9f-4327-b7a7-2a8645ecfbc3 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:59.657807 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-18dc7e24-ce9f-4327-b7a7-2a8645ecfbc3 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:59.659411 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-18dc7e24-ce9f-4327-b7a7-2a8645ecfbc3 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:59.660616 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-18dc7e24-ce9f-4327-b7a7-2a8645ecfbc3 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1740 microversion: 2.20 time: 0.616780 May 23 12:49:59.661199 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 174/328] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:49:59 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1740 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:49:59.813828 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-1d26982f-e1be-407a-8d11-b2b829cba104 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:49:59.822625 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1d26982f-e1be-407a-8d11-b2b829cba104 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.233760 May 23 12:49:59.828583 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 155/329] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:49:59 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:00.684516 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-29deaa8d-13fc-4879-9579-54d9f758d483 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:00.685171 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-29deaa8d-13fc-4879-9579-54d9f758d483 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:00.698035 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-29deaa8d-13fc-4879-9579-54d9f758d483 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:00.711099 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-29deaa8d-13fc-4879-9579-54d9f758d483 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:00.718911 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-29deaa8d-13fc-4879-9579-54d9f758d483 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:00.733572 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-29deaa8d-13fc-4879-9579-54d9f758d483 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:00.845290 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c4b91dce-a620-420c-8226-36803cd2b5c2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:00.846088 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c4b91dce-a620-420c-8226-36803cd2b5c2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:00.859898 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c4b91dce-a620-420c-8226-36803cd2b5c2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:00.860749 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c4b91dce-a620-420c-8226-36803cd2b5c2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:00.861799 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c4b91dce-a620-420c-8226-36803cd2b5c2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:00.862488 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c4b91dce-a620-420c-8226-36803cd2b5c2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:01.148955 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-29deaa8d-13fc-4879-9579-54d9f758d483 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:01.164183 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-29deaa8d-13fc-4879-9579-54d9f758d483 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:01.168485 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c4b91dce-a620-420c-8226-36803cd2b5c2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:01.169466 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-29deaa8d-13fc-4879-9579-54d9f758d483 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:01.171005 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-29deaa8d-13fc-4879-9579-54d9f758d483 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1722 microversion: 2.20 time: 0.491135 May 23 12:50:01.172777 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 175/330] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:00 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1722 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:01.200303 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c4b91dce-a620-420c-8226-36803cd2b5c2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.359539 May 23 12:50:01.201028 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 156/331] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:00 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:02.192184 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-fedd1da4-0b88-4f28-9d11-da09278ed5ca tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:02.194512 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-fedd1da4-0b88-4f28-9d11-da09278ed5ca tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:02.208517 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fedd1da4-0b88-4f28-9d11-da09278ed5ca tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:02.209378 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fedd1da4-0b88-4f28-9d11-da09278ed5ca tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:02.210362 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fedd1da4-0b88-4f28-9d11-da09278ed5ca tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:02.211021 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fedd1da4-0b88-4f28-9d11-da09278ed5ca tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:02.221099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-080401a4-ff02-40b6-912b-fe8e2bf5943a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:02.221873 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-080401a4-ff02-40b6-912b-fe8e2bf5943a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:02.241753 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-080401a4-ff02-40b6-912b-fe8e2bf5943a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:02.242209 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-080401a4-ff02-40b6-912b-fe8e2bf5943a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:02.244994 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-080401a4-ff02-40b6-912b-fe8e2bf5943a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:02.247932 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-080401a4-ff02-40b6-912b-fe8e2bf5943a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:02.301053 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=100 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:02.492626 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-080401a4-ff02-40b6-912b-fe8e2bf5943a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:02.516511 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-080401a4-ff02-40b6-912b-fe8e2bf5943a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.289603 May 23 12:50:02.516950 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 157/332] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:02 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:02.548779 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b70b431f-429d-483b-84b8-8a20df6f4319 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c160fb8f-0469-42a5-b0e7-02c3cae1eeed", "device": "/dev/sdb"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:02.550527 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b70b431f-429d-483b-84b8-8a20df6f4319 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:02.561040 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b70b431f-429d-483b-84b8-8a20df6f4319 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:02.561541 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b70b431f-429d-483b-84b8-8a20df6f4319 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:02.562517 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b70b431f-429d-483b-84b8-8a20df6f4319 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:02.563105 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b70b431f-429d-483b-84b8-8a20df6f4319 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:02.579066 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fedd1da4-0b88-4f28-9d11-da09278ed5ca tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:02.591949 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fedd1da4-0b88-4f28-9d11-da09278ed5ca tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:02.599006 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fedd1da4-0b88-4f28-9d11-da09278ed5ca tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:02.611161 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-fedd1da4-0b88-4f28-9d11-da09278ed5ca tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1722 microversion: 2.20 time: 0.422873 May 23 12:50:02.627101 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 176/333] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:02 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1722 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:03.524758 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b8f66553-3081-4bc7-83d6-a2141950cb85 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:03.525754 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b8f66553-3081-4bc7-83d6-a2141950cb85 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:03.533375 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b8f66553-3081-4bc7-83d6-a2141950cb85 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:03.534197 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b8f66553-3081-4bc7-83d6-a2141950cb85 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:03.535217 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b8f66553-3081-4bc7-83d6-a2141950cb85 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:03.535864 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b8f66553-3081-4bc7-83d6-a2141950cb85 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:03.719832 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b8f66553-3081-4bc7-83d6-a2141950cb85 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:03.731183 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b8f66553-3081-4bc7-83d6-a2141950cb85 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.208031 May 23 12:50:03.741771 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 177/334] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:03 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:03.746836 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7ae2efb2-3fa7-49d4-bbfb-276d3231d617 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:03.747587 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7ae2efb2-3fa7-49d4-bbfb-276d3231d617 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:03.754520 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7ae2efb2-3fa7-49d4-bbfb-276d3231d617 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:03.755407 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7ae2efb2-3fa7-49d4-bbfb-276d3231d617 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:03.756425 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7ae2efb2-3fa7-49d4-bbfb-276d3231d617 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:03.756962 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7ae2efb2-3fa7-49d4-bbfb-276d3231d617 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:03.983536 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7ae2efb2-3fa7-49d4-bbfb-276d3231d617 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:03.997905 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7ae2efb2-3fa7-49d4-bbfb-276d3231d617 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:03.999952 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7ae2efb2-3fa7-49d4-bbfb-276d3231d617 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:04.001491 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7ae2efb2-3fa7-49d4-bbfb-276d3231d617 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1722 microversion: 2.20 time: 0.262857 May 23 12:50:04.002874 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 178/335] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:03 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:04.177117 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b70b431f-429d-483b-84b8-8a20df6f4319 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "POST /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.658386 May 23 12:50:04.178749 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 158/336] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:50:02 2022] POST /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1/os-volume_attachments => generated 194 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:04.750069 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6858f01d-7c6e-49ac-8d6e-e140b7cde9bf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:04.750691 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6858f01d-7c6e-49ac-8d6e-e140b7cde9bf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:04.766816 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6858f01d-7c6e-49ac-8d6e-e140b7cde9bf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:04.767268 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6858f01d-7c6e-49ac-8d6e-e140b7cde9bf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:04.768061 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6858f01d-7c6e-49ac-8d6e-e140b7cde9bf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:04.768499 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6858f01d-7c6e-49ac-8d6e-e140b7cde9bf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:04.893060 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-7c1f54d5-6eaa-4872-bc4c-c95f890b3700 req-533f45f5-f329-46a7-8254-8c8bec6609d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c365608-41a1-4663-b5e2-3481874a2325", "name": "network-vif-unplugged", "status": "completed", "tag": "fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:04.917810 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-7c1f54d5-6eaa-4872-bc4c-c95f890b3700 req-533f45f5-f329-46a7-8254-8c8bec6609d4 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:04.919329 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-7c1f54d5-6eaa-4872-bc4c-c95f890b3700 req-533f45f5-f329-46a7-8254-8c8bec6609d4 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:04.958293 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.compute.server_external_events [req-7c1f54d5-6eaa-4872-bc4c-c95f890b3700 req-533f45f5-f329-46a7-8254-8c8bec6609d4 service nova] Unable to find a host for instance 0c365608-41a1-4663-b5e2-3481874a2325. Dropping event network-vif-unplugged {{(pid=134547) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 12:50:04.959728 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-7c1f54d5-6eaa-4872-bc4c-c95f890b3700 req-533f45f5-f329-46a7-8254-8c8bec6609d4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.073238 May 23 12:50:04.960504 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 159/337] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 23 12:50:05.023027 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-175520f5-2c7f-4f47-944c-f86dc4da0d04 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:05.024041 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-175520f5-2c7f-4f47-944c-f86dc4da0d04 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:05.036755 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-175520f5-2c7f-4f47-944c-f86dc4da0d04 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:05.038567 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-175520f5-2c7f-4f47-944c-f86dc4da0d04 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:05.042229 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-175520f5-2c7f-4f47-944c-f86dc4da0d04 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:05.042844 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-175520f5-2c7f-4f47-944c-f86dc4da0d04 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:05.087151 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6858f01d-7c6e-49ac-8d6e-e140b7cde9bf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:05.098613 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6858f01d-7c6e-49ac-8d6e-e140b7cde9bf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.352641 May 23 12:50:05.100740 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 179/338] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:04 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:05.298185 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-175520f5-2c7f-4f47-944c-f86dc4da0d04 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:05.325283 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-175520f5-2c7f-4f47-944c-f86dc4da0d04 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:05.348433 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-175520f5-2c7f-4f47-944c-f86dc4da0d04 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:05.356848 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-175520f5-2c7f-4f47-944c-f86dc4da0d04 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1665 microversion: 2.20 time: 0.333524 May 23 12:50:05.361343 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 160/339] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:05 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1665 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:05.383180 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-63c58f9b-024f-49d3-8327-b3ac3832bbcc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fd5c4dd-5b8c-4542-acc2-7cffff9e3b23"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:05.384988 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-63c58f9b-024f-49d3-8327-b3ac3832bbcc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:05.396520 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-63c58f9b-024f-49d3-8327-b3ac3832bbcc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:05.405944 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-63c58f9b-024f-49d3-8327-b3ac3832bbcc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:05.408409 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-63c58f9b-024f-49d3-8327-b3ac3832bbcc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:05.426977 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-63c58f9b-024f-49d3-8327-b3ac3832bbcc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:06.119896 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6a533dba-a529-4d57-8b13-2f1cbb643836 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:06.120513 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6a533dba-a529-4d57-8b13-2f1cbb643836 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:06.145221 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6a533dba-a529-4d57-8b13-2f1cbb643836 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:06.147105 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6a533dba-a529-4d57-8b13-2f1cbb643836 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:06.157761 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6a533dba-a529-4d57-8b13-2f1cbb643836 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:06.161631 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6a533dba-a529-4d57-8b13-2f1cbb643836 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:06.285944 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-63c58f9b-024f-49d3-8327-b3ac3832bbcc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "POST /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.907072 May 23 12:50:06.286919 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 180/340] 10.222.0.45 () {62 vars in 1363 bytes} [Mon May 23 12:50:05 2022] POST /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments => generated 188 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:50:06.635337 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3fc540e6-de65-47a2-a8be-8e2b45681d8d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:06.638139 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3fc540e6-de65-47a2-a8be-8e2b45681d8d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:06.655224 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3fc540e6-de65-47a2-a8be-8e2b45681d8d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:06.655679 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3fc540e6-de65-47a2-a8be-8e2b45681d8d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:06.656467 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3fc540e6-de65-47a2-a8be-8e2b45681d8d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:06.656907 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3fc540e6-de65-47a2-a8be-8e2b45681d8d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:06.731452 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6a533dba-a529-4d57-8b13-2f1cbb643836 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:06.744360 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6a533dba-a529-4d57-8b13-2f1cbb643836 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.629843 May 23 12:50:06.745522 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 161/341] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:06 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:06.840898 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3fc540e6-de65-47a2-a8be-8e2b45681d8d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "POST /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/action" status: 202 len: 0 microversion: 2.20 time: 0.209906 May 23 12:50:06.842133 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 181/342] 10.222.0.45 () {62 vars in 1318 bytes} [Mon May 23 12:50:06 2022] POST /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 12:50:06.853465 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6d5fb569-fe63-42f3-af26-b69875def273 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:06.853656 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6d5fb569-fe63-42f3-af26-b69875def273 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:06.878737 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d5fb569-fe63-42f3-af26-b69875def273 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:06.879944 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d5fb569-fe63-42f3-af26-b69875def273 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:06.883156 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d5fb569-fe63-42f3-af26-b69875def273 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:06.884175 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6d5fb569-fe63-42f3-af26-b69875def273 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:07.279444 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6d5fb569-fe63-42f3-af26-b69875def273 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:07.294347 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6d5fb569-fe63-42f3-af26-b69875def273 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:07.295970 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6d5fb569-fe63-42f3-af26-b69875def273 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:07.297178 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6d5fb569-fe63-42f3-af26-b69875def273 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1751 microversion: 2.20 time: 0.450449 May 23 12:50:07.300543 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 162/343] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:06 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1751 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:07.767405 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-71e78d03-3d20-47b4-a3bf-d1ecd625bd5d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:07.768540 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-71e78d03-3d20-47b4-a3bf-d1ecd625bd5d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:07.814698 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-71e78d03-3d20-47b4-a3bf-d1ecd625bd5d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:07.815152 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-71e78d03-3d20-47b4-a3bf-d1ecd625bd5d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:07.820275 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-71e78d03-3d20-47b4-a3bf-d1ecd625bd5d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:07.820726 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-71e78d03-3d20-47b4-a3bf-d1ecd625bd5d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:07.916808 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:07.996514 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-87da13e1-54c3-4665-b7dc-004a3b9bce7c req-bd1bce8b-18f8-42e1-a6d9-f7924a1015ee admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "c160fb8f-0469-42a5-b0e7-02c3cae1eeed", "create_info": {"type": "qcow2", "new_file": "volume-c160fb8f-0469-42a5-b0e7-02c3cae1eeed.5a0f735d-c635-4873-87f2-ed420248f4ee.vhdx", "snapshot_id": "5a0f735d-c635-4873-87f2-ed420248f4ee"}}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:08.007105 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [req-87da13e1-54c3-4665-b7dc-004a3b9bce7c req-bd1bce8b-18f8-42e1-a6d9-f7924a1015ee admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),42607727-9048-45c2-8317-fc63a315fdc3(cell1) {{(pid=134547) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 23 12:50:08.015374 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-87da13e1-54c3-4665-b7dc-004a3b9bce7c req-bd1bce8b-18f8-42e1-a6d9-f7924a1015ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:08.016199 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-87da13e1-54c3-4665-b7dc-004a3b9bce7c req-bd1bce8b-18f8-42e1-a6d9-f7924a1015ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:08.122622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-87da13e1-54c3-4665-b7dc-004a3b9bce7c req-bd1bce8b-18f8-42e1-a6d9-f7924a1015ee admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:08.123469 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-87da13e1-54c3-4665-b7dc-004a3b9bce7c req-bd1bce8b-18f8-42e1-a6d9-f7924a1015ee admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:08.144915 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-71e78d03-3d20-47b4-a3bf-d1ecd625bd5d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:08.156480 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-71e78d03-3d20-47b4-a3bf-d1ecd625bd5d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.398000 May 23 12:50:08.161110 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 182/344] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:07 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:08.194340 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-87da13e1-54c3-4665-b7dc-004a3b9bce7c req-bd1bce8b-18f8-42e1-a6d9-f7924a1015ee admin admin] 10.222.0.55 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.329965 May 23 12:50:08.196700 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 163/345] 10.222.0.55 () {64 vars in 1326 bytes} [Mon May 23 12:50:07 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 12:50:08.326290 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-903f3ca0-49f4-441a-bdfd-9398140c28fd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:08.326919 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-903f3ca0-49f4-441a-bdfd-9398140c28fd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:08.355334 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-903f3ca0-49f4-441a-bdfd-9398140c28fd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:08.357321 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-903f3ca0-49f4-441a-bdfd-9398140c28fd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:08.361656 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-903f3ca0-49f4-441a-bdfd-9398140c28fd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:08.363427 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-903f3ca0-49f4-441a-bdfd-9398140c28fd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:08.627337 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-903f3ca0-49f4-441a-bdfd-9398140c28fd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:08.637866 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-903f3ca0-49f4-441a-bdfd-9398140c28fd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:08.639673 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-903f3ca0-49f4-441a-bdfd-9398140c28fd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:08.641097 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-903f3ca0-49f4-441a-bdfd-9398140c28fd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1751 microversion: 2.20 time: 0.321578 May 23 12:50:08.641906 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 183/346] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:08 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1751 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:09.177546 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8655f0af-536d-4339-8dea-270f58b4d7df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:09.178494 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8655f0af-536d-4339-8dea-270f58b4d7df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:09.205727 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8655f0af-536d-4339-8dea-270f58b4d7df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:09.206622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8655f0af-536d-4339-8dea-270f58b4d7df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:09.207691 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8655f0af-536d-4339-8dea-270f58b4d7df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:09.208364 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8655f0af-536d-4339-8dea-270f58b4d7df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:09.495646 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8655f0af-536d-4339-8dea-270f58b4d7df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:09.505888 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8655f0af-536d-4339-8dea-270f58b4d7df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.334308 May 23 12:50:09.508132 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 164/347] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:09 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:09.660320 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3b8aa2b1-f2bf-4d52-ac18-886d0bd963c0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:09.661097 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3b8aa2b1-f2bf-4d52-ac18-886d0bd963c0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:09.677957 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3b8aa2b1-f2bf-4d52-ac18-886d0bd963c0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:09.683277 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3b8aa2b1-f2bf-4d52-ac18-886d0bd963c0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:09.685756 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3b8aa2b1-f2bf-4d52-ac18-886d0bd963c0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:09.686278 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3b8aa2b1-f2bf-4d52-ac18-886d0bd963c0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:09.972076 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3b8aa2b1-f2bf-4d52-ac18-886d0bd963c0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:09.983745 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3b8aa2b1-f2bf-4d52-ac18-886d0bd963c0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:09.985373 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3b8aa2b1-f2bf-4d52-ac18-886d0bd963c0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:09.986559 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3b8aa2b1-f2bf-4d52-ac18-886d0bd963c0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1751 microversion: 2.20 time: 0.330464 May 23 12:50:09.987432 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 184/348] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:09 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1751 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:10.523927 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-18f713c4-d4b6-4309-8ad7-45374d61b57b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:10.524678 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-18f713c4-d4b6-4309-8ad7-45374d61b57b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:10.535889 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-18f713c4-d4b6-4309-8ad7-45374d61b57b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:10.536632 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-18f713c4-d4b6-4309-8ad7-45374d61b57b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:10.541732 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-18f713c4-d4b6-4309-8ad7-45374d61b57b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:10.542371 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-18f713c4-d4b6-4309-8ad7-45374d61b57b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:10.968896 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-18f713c4-d4b6-4309-8ad7-45374d61b57b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:10.994855 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-18f713c4-d4b6-4309-8ad7-45374d61b57b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.473971 May 23 12:50:10.995604 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 165/349] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:10 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:11.006054 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-fdb6779c-aa37-4bb7-b866-f4f30e04907a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:11.021192 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-fdb6779c-aa37-4bb7-b866-f4f30e04907a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:11.021192 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fdb6779c-aa37-4bb7-b866-f4f30e04907a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:11.021192 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fdb6779c-aa37-4bb7-b866-f4f30e04907a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:11.021192 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fdb6779c-aa37-4bb7-b866-f4f30e04907a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:11.021650 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fdb6779c-aa37-4bb7-b866-f4f30e04907a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:11.265803 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fdb6779c-aa37-4bb7-b866-f4f30e04907a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:11.277386 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fdb6779c-aa37-4bb7-b866-f4f30e04907a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:11.279065 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fdb6779c-aa37-4bb7-b866-f4f30e04907a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:11.280334 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-fdb6779c-aa37-4bb7-b866-f4f30e04907a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1751 microversion: 2.20 time: 0.278356 May 23 12:50:11.280878 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 185/350] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:11 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1751 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:12.018268 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c4ecd227-b736-47b8-9458-0c14e8b690f6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:12.021546 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c4ecd227-b736-47b8-9458-0c14e8b690f6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:12.038894 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c4ecd227-b736-47b8-9458-0c14e8b690f6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:12.039347 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c4ecd227-b736-47b8-9458-0c14e8b690f6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:12.040768 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c4ecd227-b736-47b8-9458-0c14e8b690f6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:12.041240 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c4ecd227-b736-47b8-9458-0c14e8b690f6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:12.111062 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-64648fa2-d2d0-414b-961a-0a8b147937a8 req-41d9513f-c0b0-4e64-ad62-5f1cdfb8b681 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "c160fb8f-0469-42a5-b0e7-02c3cae1eeed", "create_info": {"type": "qcow2", "new_file": "volume-c160fb8f-0469-42a5-b0e7-02c3cae1eeed.fd27d97c-e311-4816-bf63-664ec5fa7137.vhdx", "snapshot_id": "fd27d97c-e311-4816-bf63-664ec5fa7137"}}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:12.131270 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [req-64648fa2-d2d0-414b-961a-0a8b147937a8 req-41d9513f-c0b0-4e64-ad62-5f1cdfb8b681 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),42607727-9048-45c2-8317-fc63a315fdc3(cell1) {{(pid=134546) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 23 12:50:12.132203 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-64648fa2-d2d0-414b-961a-0a8b147937a8 req-41d9513f-c0b0-4e64-ad62-5f1cdfb8b681 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:12.132880 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-64648fa2-d2d0-414b-961a-0a8b147937a8 req-41d9513f-c0b0-4e64-ad62-5f1cdfb8b681 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:12.218987 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-64648fa2-d2d0-414b-961a-0a8b147937a8 req-41d9513f-c0b0-4e64-ad62-5f1cdfb8b681 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:12.219978 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-64648fa2-d2d0-414b-961a-0a8b147937a8 req-41d9513f-c0b0-4e64-ad62-5f1cdfb8b681 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:12.257694 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-64648fa2-d2d0-414b-961a-0a8b147937a8 req-41d9513f-c0b0-4e64-ad62-5f1cdfb8b681 admin admin] 10.222.0.55 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.219264 May 23 12:50:12.259090 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 186/351] 10.222.0.55 () {64 vars in 1326 bytes} [Mon May 23 12:50:12 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:50:12.264504 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c4ecd227-b736-47b8-9458-0c14e8b690f6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:12.277039 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c4ecd227-b736-47b8-9458-0c14e8b690f6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.262972 May 23 12:50:12.278257 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 166/352] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:12 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:12.300383 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6640d351-e34c-4b6a-83d3-6af8511e523c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:12.302040 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6640d351-e34c-4b6a-83d3-6af8511e523c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:12.318491 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6640d351-e34c-4b6a-83d3-6af8511e523c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:12.318741 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6640d351-e34c-4b6a-83d3-6af8511e523c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:12.319609 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6640d351-e34c-4b6a-83d3-6af8511e523c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:12.320368 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6640d351-e34c-4b6a-83d3-6af8511e523c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:12.548327 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6640d351-e34c-4b6a-83d3-6af8511e523c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:12.558183 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6640d351-e34c-4b6a-83d3-6af8511e523c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:12.559687 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6640d351-e34c-4b6a-83d3-6af8511e523c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:12.560856 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6640d351-e34c-4b6a-83d3-6af8511e523c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1751 microversion: 2.20 time: 0.265100 May 23 12:50:12.561740 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 187/353] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:12 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1751 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:13.295977 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ffbdd978-7d85-4940-a0ca-aac67a1cec6c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:13.297384 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ffbdd978-7d85-4940-a0ca-aac67a1cec6c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:13.304363 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ffbdd978-7d85-4940-a0ca-aac67a1cec6c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:13.305161 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ffbdd978-7d85-4940-a0ca-aac67a1cec6c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:13.307188 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ffbdd978-7d85-4940-a0ca-aac67a1cec6c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:13.307874 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ffbdd978-7d85-4940-a0ca-aac67a1cec6c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:13.579599 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f2282e8d-533d-4b9d-9493-b83aa877a0c4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:13.580613 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f2282e8d-533d-4b9d-9493-b83aa877a0c4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:13.593250 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f2282e8d-533d-4b9d-9493-b83aa877a0c4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:13.593675 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f2282e8d-533d-4b9d-9493-b83aa877a0c4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:13.594217 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f2282e8d-533d-4b9d-9493-b83aa877a0c4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:13.594562 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f2282e8d-533d-4b9d-9493-b83aa877a0c4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:13.612228 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ffbdd978-7d85-4940-a0ca-aac67a1cec6c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:13.621498 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ffbdd978-7d85-4940-a0ca-aac67a1cec6c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.329291 May 23 12:50:13.627428 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 167/354] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:13 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:13.792331 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f2282e8d-533d-4b9d-9493-b83aa877a0c4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:13.814042 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f2282e8d-533d-4b9d-9493-b83aa877a0c4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:13.816050 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f2282e8d-533d-4b9d-9493-b83aa877a0c4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:13.817767 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f2282e8d-533d-4b9d-9493-b83aa877a0c4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1751 microversion: 2.20 time: 0.242362 May 23 12:50:13.818596 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 188/355] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:13 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1751 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:14.648270 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-86aa9a0b-126e-4d7a-b312-71db6cde5a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:14.650629 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-86aa9a0b-126e-4d7a-b312-71db6cde5a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:14.658875 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-86aa9a0b-126e-4d7a-b312-71db6cde5a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:14.659888 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-86aa9a0b-126e-4d7a-b312-71db6cde5a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:14.661651 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-86aa9a0b-126e-4d7a-b312-71db6cde5a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:14.662451 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-86aa9a0b-126e-4d7a-b312-71db6cde5a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:14.835855 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-948f6689-a680-4a9c-a721-afedfef9792c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:14.837126 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-948f6689-a680-4a9c-a721-afedfef9792c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:14.839755 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:14.861476 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-948f6689-a680-4a9c-a721-afedfef9792c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:14.862012 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-948f6689-a680-4a9c-a721-afedfef9792c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:14.862831 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-948f6689-a680-4a9c-a721-afedfef9792c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:14.863278 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-948f6689-a680-4a9c-a721-afedfef9792c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:14.864677 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-86aa9a0b-126e-4d7a-b312-71db6cde5a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:14.876883 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-86aa9a0b-126e-4d7a-b312-71db6cde5a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.233050 May 23 12:50:14.878193 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 168/356] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:14 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:15.220363 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-948f6689-a680-4a9c-a721-afedfef9792c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:15.239910 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-948f6689-a680-4a9c-a721-afedfef9792c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:15.244095 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-948f6689-a680-4a9c-a721-afedfef9792c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:15.245365 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-948f6689-a680-4a9c-a721-afedfef9792c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1751 microversion: 2.20 time: 0.413372 May 23 12:50:15.249106 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 189/357] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:14 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1751 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:15.641272 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-25f89e25-abf6-49c7-9c6a-875ca7bf3236 req-7cf80298-de75-4d1e-ab39-ff2983b24214 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "c160fb8f-0469-42a5-b0e7-02c3cae1eeed", "create_info": {"type": "qcow2", "new_file": "volume-c160fb8f-0469-42a5-b0e7-02c3cae1eeed.25ec72e9-f93c-4e96-9951-923a3743b3c8.vhdx", "snapshot_id": "25ec72e9-f93c-4e96-9951-923a3743b3c8"}}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:15.643922 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-25f89e25-abf6-49c7-9c6a-875ca7bf3236 req-7cf80298-de75-4d1e-ab39-ff2983b24214 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:15.644582 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-25f89e25-abf6-49c7-9c6a-875ca7bf3236 req-7cf80298-de75-4d1e-ab39-ff2983b24214 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:15.660824 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-25f89e25-abf6-49c7-9c6a-875ca7bf3236 req-7cf80298-de75-4d1e-ab39-ff2983b24214 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:15.662357 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-25f89e25-abf6-49c7-9c6a-875ca7bf3236 req-7cf80298-de75-4d1e-ab39-ff2983b24214 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:15.683391 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-25f89e25-abf6-49c7-9c6a-875ca7bf3236 req-7cf80298-de75-4d1e-ab39-ff2983b24214 admin admin] 10.222.0.55 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.114229 May 23 12:50:15.684311 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 169/358] 10.222.0.55 () {64 vars in 1326 bytes} [Mon May 23 12:50:15 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 12:50:15.898455 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7c084462-8c0d-40e3-8bca-109e5743e1b6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:15.901917 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7c084462-8c0d-40e3-8bca-109e5743e1b6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:15.909508 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7c084462-8c0d-40e3-8bca-109e5743e1b6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:15.910207 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7c084462-8c0d-40e3-8bca-109e5743e1b6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:15.911164 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7c084462-8c0d-40e3-8bca-109e5743e1b6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:15.914451 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7c084462-8c0d-40e3-8bca-109e5743e1b6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:16.096669 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7c084462-8c0d-40e3-8bca-109e5743e1b6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:16.109945 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7c084462-8c0d-40e3-8bca-109e5743e1b6 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.215680 May 23 12:50:16.145541 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 190/359] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:15 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:16.284037 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-92e9e9a9-1f52-4b3f-a3bb-73ac472e6684 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:16.285189 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-92e9e9a9-1f52-4b3f-a3bb-73ac472e6684 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:16.316469 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-92e9e9a9-1f52-4b3f-a3bb-73ac472e6684 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:16.317240 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-92e9e9a9-1f52-4b3f-a3bb-73ac472e6684 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:16.318187 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-92e9e9a9-1f52-4b3f-a3bb-73ac472e6684 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:16.318801 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-92e9e9a9-1f52-4b3f-a3bb-73ac472e6684 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:16.566947 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-92e9e9a9-1f52-4b3f-a3bb-73ac472e6684 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:16.582370 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-92e9e9a9-1f52-4b3f-a3bb-73ac472e6684 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:16.586118 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-92e9e9a9-1f52-4b3f-a3bb-73ac472e6684 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:16.590735 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-92e9e9a9-1f52-4b3f-a3bb-73ac472e6684 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1751 microversion: 2.20 time: 0.312549 May 23 12:50:16.597292 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 170/360] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:16 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1751 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:17.117955 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6c746d7d-6aaf-40ce-90e4-21c0db3e6a91 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Action: 'create', calling method: .version_select at 0x7f6a36d93670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-271766976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLES4lkWDntMFjdHol1KXBZD6h7x4VRq3tVKOTD/VXbQzwLsp2oMfA5MY7Wz9yo08BqfqSjRqIhfvsx1Uo34o7XNhvtUYjYTqk1lQlpJYiIqSoUrbRobMPRqLwVT/vQ3pw=="}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:17.136702 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-6c746d7d-6aaf-40ce-90e4-21c0db3e6a91 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Getting quotas for project a0ef120b9d274ff4b3db10ea968e99d1. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:50:17.141567 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-6c746d7d-6aaf-40ce-90e4-21c0db3e6a91 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Getting quotas for user 29b73578628342a6a5751a6cb6cb7a7e and project a0ef120b9d274ff4b3db10ea968e99d1. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:50:17.158836 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-77d16055-9ff6-4081-a574-93e8096d66f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:17.161432 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-77d16055-9ff6-4081-a574-93e8096d66f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:17.185816 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77d16055-9ff6-4081-a574-93e8096d66f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:17.188966 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77d16055-9ff6-4081-a574-93e8096d66f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:17.192630 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77d16055-9ff6-4081-a574-93e8096d66f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:17.193795 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6c746d7d-6aaf-40ce-90e4-21c0db3e6a91 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.082434 May 23 12:50:17.194736 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77d16055-9ff6-4081-a574-93e8096d66f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:17.206886 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 191/361] 10.222.0.45 () {60 vars in 1158 bytes} [Mon May 23 12:50:17 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:17.291992 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1650962559", "imageRef": "5c1e0b48-fa64-4c39-95ca-7946ae6b2a78", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-271766976", "networks": [{"uuid": "65509613-1940-47ce-b05d-c87f07f38851"}]}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:17.386342 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.network.neutron [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] validate_networks() for [('65509613-1940-47ce-b05d-c87f07f38851', None, None, None, None, None)] {{(pid=134546) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:50:17.519739 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-77d16055-9ff6-4081-a574-93e8096d66f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:17.532951 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-77d16055-9ff6-4081-a574-93e8096d66f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.388327 May 23 12:50:17.534862 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 171/362] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:17 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:17.609815 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-78bd9033-d9c3-40c6-b207-aa3e2ea4041b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:17.611622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-78bd9033-d9c3-40c6-b207-aa3e2ea4041b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:17.620655 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-78bd9033-d9c3-40c6-b207-aa3e2ea4041b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:17.625662 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-78bd9033-d9c3-40c6-b207-aa3e2ea4041b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:17.627270 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-78bd9033-d9c3-40c6-b207-aa3e2ea4041b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:17.628018 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-78bd9033-d9c3-40c6-b207-aa3e2ea4041b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:17.842214 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-78bd9033-d9c3-40c6-b207-aa3e2ea4041b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:17.855184 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-78bd9033-d9c3-40c6-b207-aa3e2ea4041b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:17.857653 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-78bd9033-d9c3-40c6-b207-aa3e2ea4041b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:17.859615 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-78bd9033-d9c3-40c6-b207-aa3e2ea4041b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1751 microversion: 2.20 time: 0.253731 May 23 12:50:17.873760 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 172/363] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:17 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1751 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:18.094833 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Flavor limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:50:18.095244 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Image limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:50:18.095702 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Flavor pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:50:18.096098 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Image pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:50:18.096505 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:50:18.112288 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:18.112835 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:18.113904 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:18.114563 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:18.152576 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Getting quotas for project a0ef120b9d274ff4b3db10ea968e99d1. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:50:18.157901 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Getting quotas for user 29b73578628342a6a5751a6cb6cb7a7e and project a0ef120b9d274ff4b3db10ea968e99d1. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:50:18.170878 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Going to run 1 instances... {{(pid=134546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:50:18.173674 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5c1e0b48-fa64-4c39-95ca-7946ae6b2a78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:50:18.226055 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-315fd960-2406-4d29-9a80-4f78008b1f2e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942421 May 23 12:50:18.227720 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 192/364] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:50:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:50:18.237250 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-fececff5-d61e-4a30-9e59-b9ce3176193d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:18.238492 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-fececff5-d61e-4a30-9e59-b9ce3176193d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:18.320216 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-fececff5-d61e-4a30-9e59-b9ce3176193d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:18.349109 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-fececff5-d61e-4a30-9e59-b9ce3176193d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1258 microversion: 2.1 time: 0.115672 May 23 12:50:18.351149 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 173/365] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:18 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1258 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:18.550206 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-797e3f03-bfbf-46e2-9f12-970bf7532469 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:18.550879 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-797e3f03-bfbf-46e2-9f12-970bf7532469 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:18.560573 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-797e3f03-bfbf-46e2-9f12-970bf7532469 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:18.562249 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-797e3f03-bfbf-46e2-9f12-970bf7532469 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:18.563269 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-797e3f03-bfbf-46e2-9f12-970bf7532469 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:18.563870 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-797e3f03-bfbf-46e2-9f12-970bf7532469 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:18.769112 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-797e3f03-bfbf-46e2-9f12-970bf7532469 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:18.779431 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-797e3f03-bfbf-46e2-9f12-970bf7532469 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.233122 May 23 12:50:18.785041 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 193/366] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:18 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:18.822004 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-6a76d522-3b00-46ef-b5aa-18d456e670de req-d6b24e91-723f-48f3-812c-6cf54b569287 admin admin] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:18.827758 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-6a76d522-3b00-46ef-b5aa-18d456e670de req-d6b24e91-723f-48f3-812c-6cf54b569287 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:18.829279 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-6a76d522-3b00-46ef-b5aa-18d456e670de req-d6b24e91-723f-48f3-812c-6cf54b569287 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:18.862347 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-6a76d522-3b00-46ef-b5aa-18d456e670de req-d6b24e91-723f-48f3-812c-6cf54b569287 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:18.863577 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-6a76d522-3b00-46ef-b5aa-18d456e670de req-d6b24e91-723f-48f3-812c-6cf54b569287 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:18.889192 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-6a76d522-3b00-46ef-b5aa-18d456e670de req-d6b24e91-723f-48f3-812c-6cf54b569287 admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/5a0f735d-c635-4873-87f2-ed420248f4ee?delete_info=%7B%22file_to_merge%22:%20%22volume-c160fb8f-0469-42a5-b0e7-02c3cae1eeed.5a0f735d-c635-4873-87f2-ed420248f4ee.vhdx%22,%20%22volume_id%22:%20%22c160fb8f-0469-42a5-b0e7-02c3cae1eeed%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.186862 May 23 12:50:18.890506 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 174/367] 10.222.0.55 () {62 vars in 1800 bytes} [Mon May 23 12:50:18 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/5a0f735d-c635-4873-87f2-ed420248f4ee?delete_info=%7B%22file_to_merge%22:%20%22volume-c160fb8f-0469-42a5-b0e7-02c3cae1eeed.5a0f735d-c635-4873-87f2-ed420248f4ee.vhdx%22,%20%22volume_id%22:%20%22c160fb8f-0469-42a5-b0e7-02c3cae1eeed%22%7D => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 12:50:18.892664 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a5e387c5-15b5-4de2-8312-7587056ceeaa tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:18.894886 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a5e387c5-15b5-4de2-8312-7587056ceeaa tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:18.928648 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a5e387c5-15b5-4de2-8312-7587056ceeaa tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:18.929322 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a5e387c5-15b5-4de2-8312-7587056ceeaa tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:18.937647 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a5e387c5-15b5-4de2-8312-7587056ceeaa tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:18.938209 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a5e387c5-15b5-4de2-8312-7587056ceeaa tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:19.160448 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a5e387c5-15b5-4de2-8312-7587056ceeaa tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:19.171409 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a5e387c5-15b5-4de2-8312-7587056ceeaa tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:19.173661 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a5e387c5-15b5-4de2-8312-7587056ceeaa tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:19.175293 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a5e387c5-15b5-4de2-8312-7587056ceeaa tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1753 microversion: 2.20 time: 0.297378 May 23 12:50:19.175983 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 194/368] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:18 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1753 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:19.367334 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-15150d34-6886-44a2-8212-4f1f4d510d43 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:19.369119 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-15150d34-6886-44a2-8212-4f1f4d510d43 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:19.371348 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=58 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:19.377396 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-15150d34-6886-44a2-8212-4f1f4d510d43 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:19.377965 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-15150d34-6886-44a2-8212-4f1f4d510d43 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:19.378729 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-15150d34-6886-44a2-8212-4f1f4d510d43 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:19.379166 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-15150d34-6886-44a2-8212-4f1f4d510d43 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:19.443822 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-15150d34-6886-44a2-8212-4f1f4d510d43 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:19.451295 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-15150d34-6886-44a2-8212-4f1f4d510d43 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1310 microversion: 2.1 time: 0.088379 May 23 12:50:19.451893 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 175/369] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:19 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:19.802484 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8e71406a-bb03-41d4-99d1-d9702ca7876d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:19.803087 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8e71406a-bb03-41d4-99d1-d9702ca7876d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:19.809436 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8e71406a-bb03-41d4-99d1-d9702ca7876d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:19.809883 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8e71406a-bb03-41d4-99d1-d9702ca7876d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:19.810658 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8e71406a-bb03-41d4-99d1-d9702ca7876d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:19.811084 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8e71406a-bb03-41d4-99d1-d9702ca7876d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:19.943826 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8e71406a-bb03-41d4-99d1-d9702ca7876d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:19.951678 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8e71406a-bb03-41d4-99d1-d9702ca7876d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.152914 May 23 12:50:19.952232 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 195/370] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:19 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:20.199660 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-10fb6384-4b35-443c-b111-11f63f7f7535 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:20.200262 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-10fb6384-4b35-443c-b111-11f63f7f7535 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:20.206245 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10fb6384-4b35-443c-b111-11f63f7f7535 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:20.206691 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10fb6384-4b35-443c-b111-11f63f7f7535 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:20.207438 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10fb6384-4b35-443c-b111-11f63f7f7535 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:20.207865 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-10fb6384-4b35-443c-b111-11f63f7f7535 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:20.226398 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:20.357518 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-10fb6384-4b35-443c-b111-11f63f7f7535 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:20.366457 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-10fb6384-4b35-443c-b111-11f63f7f7535 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:20.368482 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-10fb6384-4b35-443c-b111-11f63f7f7535 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:20.370614 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-10fb6384-4b35-443c-b111-11f63f7f7535 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1753 microversion: 2.20 time: 0.174984 May 23 12:50:20.371358 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 176/371] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:20 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:20.469002 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b198f3a0-4957-4ba7-b062-30b1755ecde8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:20.469664 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b198f3a0-4957-4ba7-b062-30b1755ecde8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:20.476163 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b198f3a0-4957-4ba7-b062-30b1755ecde8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:20.476610 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b198f3a0-4957-4ba7-b062-30b1755ecde8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:20.477470 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b198f3a0-4957-4ba7-b062-30b1755ecde8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:20.477884 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b198f3a0-4957-4ba7-b062-30b1755ecde8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:20.540762 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b198f3a0-4957-4ba7-b062-30b1755ecde8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:20.548555 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b198f3a0-4957-4ba7-b062-30b1755ecde8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1310 microversion: 2.1 time: 0.084480 May 23 12:50:20.549101 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 196/372] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:20 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:20.968813 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-577df7d3-42d4-417b-b7f1-bc84705f8a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:20.969448 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-577df7d3-42d4-417b-b7f1-bc84705f8a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:20.976279 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-577df7d3-42d4-417b-b7f1-bc84705f8a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:20.976726 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-577df7d3-42d4-417b-b7f1-bc84705f8a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:20.977807 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-577df7d3-42d4-417b-b7f1-bc84705f8a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:20.978370 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-577df7d3-42d4-417b-b7f1-bc84705f8a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.126295 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-577df7d3-42d4-417b-b7f1-bc84705f8a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:21.133662 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-577df7d3-42d4-417b-b7f1-bc84705f8a02 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1501 microversion: 2.1 time: 0.169091 May 23 12:50:21.134229 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 177/373] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:20 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:21.151003 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-75b4e215-3c4a-4bd7-866a-8f148ebe5489 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1ac9823-a57a-4968-9b9c-68561fc1ecdf"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:21.152114 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-75b4e215-3c4a-4bd7-866a-8f148ebe5489 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:21.158213 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-75b4e215-3c4a-4bd7-866a-8f148ebe5489 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:21.158670 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-75b4e215-3c4a-4bd7-866a-8f148ebe5489 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.159422 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-75b4e215-3c4a-4bd7-866a-8f148ebe5489 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:21.159857 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-75b4e215-3c4a-4bd7-866a-8f148ebe5489 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.184722 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-75b4e215-3c4a-4bd7-866a-8f148ebe5489 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] HTTP exception thrown: Cannot 'attach_volume' instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 while it is in vm_state rescued May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-75b4e215-3c4a-4bd7-866a-8f148ebe5489 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Request method failure captured: May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: POST /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156/os-volume_attachments HTTP/1.1 May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 74 May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4KmP_azytTUVLXNckphaPdAaLly42fx__PDc1LKD4jdw5xA3BQJA7YCs-jJSyC1EgTilp6eFPCuWOn4bgqZB6Ca_Cc8vgLBCx4axkRxczK028StFWqZENxl-CpLJ12vWGyihsxUYlg7PZ0INoaYGAHss53fwTUh_R2ok0ygOjO_MVI May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 3433fceb10214afcbc819edcec864651 May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:50:21.186761 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3433fceb10214afcbc819edcec864651"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3433fceb10214afcbc819edcec864651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3433fceb10214afcbc819edcec864651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3433fceb10214afcbc819edcec864651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 3433fceb10214afcbc819edcec864651 May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-ServerRescueNegativeTestJSON-1104474870-project May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: e90f349f384245fb8a118be176ad6829 May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1104474870-project May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: {"volumeAttachment": {"volumeId": "f1ac9823-a57a-4968-9b9c-68561fc1ecdf"}} May 23 12:50:21.188263 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Cannot 'attach_volume' instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 while it is in vm_state rescued May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'server_id': '73837a44-cd22-4db0-a18c-ecd5f3ec8156', 'body': {'volumeAttachment': {'volumeId': 'f1ac9823-a57a-4968-9b9c-68561fc1ecdf'}}} May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:50:21.189132 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 while it is in vm_state rescued May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:50:21.190563 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:50:21.191896 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:50:21.191896 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:50:21.191896 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 while it is in vm_state rescued May 23 12:50:21.191896 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:50:21.191896 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-75b4e215-3c4a-4bd7-866a-8f148ebe5489 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Returning 409 to user: Cannot 'attach_volume' instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 while it is in vm_state rescued {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:50:21.191896 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-75b4e215-3c4a-4bd7-866a-8f148ebe5489 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042058 May 23 12:50:21.191896 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 197/374] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:50:21 2022] POST /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 23 12:50:21.197630 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-29700128-d054-4a5b-bf44-4b93486a30ae tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:21.198165 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-29700128-d054-4a5b-bf44-4b93486a30ae tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:21.204150 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-29700128-d054-4a5b-bf44-4b93486a30ae tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:21.204599 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-29700128-d054-4a5b-bf44-4b93486a30ae tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.205381 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-29700128-d054-4a5b-bf44-4b93486a30ae tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:21.205817 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-29700128-d054-4a5b-bf44-4b93486a30ae tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.269800 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-29700128-d054-4a5b-bf44-4b93486a30ae tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156/action" status: 202 len: 0 microversion: 2.1 time: 0.075988 May 23 12:50:21.270448 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 178/375] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:50:21 2022] POST /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:50:21.279358 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4b8ad045-b1cb-4967-a99b-ac1b049e3724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:21.280039 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4b8ad045-b1cb-4967-a99b-ac1b049e3724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:21.286592 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4b8ad045-b1cb-4967-a99b-ac1b049e3724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:21.287090 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4b8ad045-b1cb-4967-a99b-ac1b049e3724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.287844 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4b8ad045-b1cb-4967-a99b-ac1b049e3724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:21.288268 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4b8ad045-b1cb-4967-a99b-ac1b049e3724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.389437 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-17a0fef8-4caf-4373-aeca-018d2062b0dd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:21.390138 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-17a0fef8-4caf-4373-aeca-018d2062b0dd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:21.396579 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17a0fef8-4caf-4373-aeca-018d2062b0dd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:21.397017 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17a0fef8-4caf-4373-aeca-018d2062b0dd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.397801 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17a0fef8-4caf-4373-aeca-018d2062b0dd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:21.398226 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17a0fef8-4caf-4373-aeca-018d2062b0dd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.417912 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4b8ad045-b1cb-4967-a99b-ac1b049e3724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:21.425204 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4b8ad045-b1cb-4967-a99b-ac1b049e3724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.149728 May 23 12:50:21.425760 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 198/376] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:21 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:21.531927 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-17a0fef8-4caf-4373-aeca-018d2062b0dd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:21.541098 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-17a0fef8-4caf-4373-aeca-018d2062b0dd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:21.542631 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-17a0fef8-4caf-4373-aeca-018d2062b0dd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:21.543784 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-17a0fef8-4caf-4373-aeca-018d2062b0dd tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.158723 May 23 12:50:21.544344 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 179/377] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:21 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:21.565690 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7f7d5055-ebac-4eac-bf14-6e7805bbe5bf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:21.566383 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7f7d5055-ebac-4eac-bf14-6e7805bbe5bf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:21.572393 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7f7d5055-ebac-4eac-bf14-6e7805bbe5bf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:21.572910 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7f7d5055-ebac-4eac-bf14-6e7805bbe5bf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.573696 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7f7d5055-ebac-4eac-bf14-6e7805bbe5bf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:21.574130 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7f7d5055-ebac-4eac-bf14-6e7805bbe5bf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:21.634443 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7f7d5055-ebac-4eac-bf14-6e7805bbe5bf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:21.642879 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7f7d5055-ebac-4eac-bf14-6e7805bbe5bf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1318 microversion: 2.1 time: 0.080992 May 23 12:50:21.643622 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 199/378] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:21 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1318 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:22.442136 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-701743ae-ad24-4f78-872f-6947a41af6ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:22.442738 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-701743ae-ad24-4f78-872f-6947a41af6ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:22.450257 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-701743ae-ad24-4f78-872f-6947a41af6ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:22.450912 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-701743ae-ad24-4f78-872f-6947a41af6ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:22.451677 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-701743ae-ad24-4f78-872f-6947a41af6ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:22.452110 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-701743ae-ad24-4f78-872f-6947a41af6ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:22.563254 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ec6677d8-547f-4b23-94f8-1893d7434f69 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:22.563866 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ec6677d8-547f-4b23-94f8-1893d7434f69 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:22.572733 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ec6677d8-547f-4b23-94f8-1893d7434f69 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:22.573409 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ec6677d8-547f-4b23-94f8-1893d7434f69 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:22.574164 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ec6677d8-547f-4b23-94f8-1893d7434f69 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:22.574634 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ec6677d8-547f-4b23-94f8-1893d7434f69 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:22.630795 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-701743ae-ad24-4f78-872f-6947a41af6ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:22.640051 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-701743ae-ad24-4f78-872f-6947a41af6ff tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.201651 May 23 12:50:22.640829 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 180/379] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:22 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:22.661203 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-26397afd-dc04-4bcf-a863-1c0b3487c028 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:22.662166 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-26397afd-dc04-4bcf-a863-1c0b3487c028 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:22.669578 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-26397afd-dc04-4bcf-a863-1c0b3487c028 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:22.670148 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-26397afd-dc04-4bcf-a863-1c0b3487c028 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:22.671016 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-26397afd-dc04-4bcf-a863-1c0b3487c028 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:22.671503 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-26397afd-dc04-4bcf-a863-1c0b3487c028 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:22.756900 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-26397afd-dc04-4bcf-a863-1c0b3487c028 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:22.766638 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-26397afd-dc04-4bcf-a863-1c0b3487c028 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1316 microversion: 2.1 time: 0.109647 May 23 12:50:22.768583 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 181/380] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:22 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1316 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:22.992643 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ec6677d8-547f-4b23-94f8-1893d7434f69 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:23.011674 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-d352c52f-3208-487f-8d90-aba1a5f79647 req-6df704ad-bcb1-449a-b917-d6b1dc5fcae0 admin admin] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:23.013772 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-d352c52f-3208-487f-8d90-aba1a5f79647 req-6df704ad-bcb1-449a-b917-d6b1dc5fcae0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:23.014360 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-d352c52f-3208-487f-8d90-aba1a5f79647 req-6df704ad-bcb1-449a-b917-d6b1dc5fcae0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:23.017578 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ec6677d8-547f-4b23-94f8-1893d7434f69 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:23.021560 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ec6677d8-547f-4b23-94f8-1893d7434f69 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:23.022764 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ec6677d8-547f-4b23-94f8-1893d7434f69 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.464023 May 23 12:50:23.031219 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-d352c52f-3208-487f-8d90-aba1a5f79647 req-6df704ad-bcb1-449a-b917-d6b1dc5fcae0 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:23.031721 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 200/381] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:22 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:23.041947 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-d352c52f-3208-487f-8d90-aba1a5f79647 req-6df704ad-bcb1-449a-b917-d6b1dc5fcae0 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:23.063759 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-d352c52f-3208-487f-8d90-aba1a5f79647 req-6df704ad-bcb1-449a-b917-d6b1dc5fcae0 admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/25ec72e9-f93c-4e96-9951-923a3743b3c8?delete_info=%7B%22file_to_merge%22:%20%22volume-c160fb8f-0469-42a5-b0e7-02c3cae1eeed.25ec72e9-f93c-4e96-9951-923a3743b3c8.vhdx%22,%20%22volume_id%22:%20%22c160fb8f-0469-42a5-b0e7-02c3cae1eeed%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.158943 May 23 12:50:23.068374 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 182/382] 10.222.0.55 () {62 vars in 1800 bytes} [Mon May 23 12:50:22 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/25ec72e9-f93c-4e96-9951-923a3743b3c8?delete_info=%7B%22file_to_merge%22:%20%22volume-c160fb8f-0469-42a5-b0e7-02c3cae1eeed.25ec72e9-f93c-4e96-9951-923a3743b3c8.vhdx%22,%20%22volume_id%22:%20%22c160fb8f-0469-42a5-b0e7-02c3cae1eeed%22%7D => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:50:23.661362 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-67029ca7-3322-4833-9681-e93ab9dbcca2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:23.662683 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-67029ca7-3322-4833-9681-e93ab9dbcca2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:23.672168 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-67029ca7-3322-4833-9681-e93ab9dbcca2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:23.672792 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-67029ca7-3322-4833-9681-e93ab9dbcca2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:23.674183 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-67029ca7-3322-4833-9681-e93ab9dbcca2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:23.675200 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-67029ca7-3322-4833-9681-e93ab9dbcca2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:23.791930 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1e25ce97-a862-462c-9ce4-143e0625dcb0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:23.793372 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1e25ce97-a862-462c-9ce4-143e0625dcb0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:23.803205 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1e25ce97-a862-462c-9ce4-143e0625dcb0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:23.805043 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1e25ce97-a862-462c-9ce4-143e0625dcb0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:23.806851 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1e25ce97-a862-462c-9ce4-143e0625dcb0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:23.807699 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1e25ce97-a862-462c-9ce4-143e0625dcb0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:23.842146 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-67029ca7-3322-4833-9681-e93ab9dbcca2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:23.846580 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=100 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:23.869124 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-67029ca7-3322-4833-9681-e93ab9dbcca2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.213221 May 23 12:50:23.875342 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 201/383] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:23 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:23.974447 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-1e25ce97-a862-462c-9ce4-143e0625dcb0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:23.982354 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1e25ce97-a862-462c-9ce4-143e0625dcb0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.199809 May 23 12:50:23.982928 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 183/384] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:23 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:24.043197 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-aed3fd40-5c50-460d-a2db-a2c535082386 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:24.043729 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-aed3fd40-5c50-460d-a2db-a2c535082386 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:24.052094 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aed3fd40-5c50-460d-a2db-a2c535082386 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:24.052656 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aed3fd40-5c50-460d-a2db-a2c535082386 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:24.053691 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aed3fd40-5c50-460d-a2db-a2c535082386 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:24.054220 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aed3fd40-5c50-460d-a2db-a2c535082386 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:24.197223 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-aed3fd40-5c50-460d-a2db-a2c535082386 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:24.206218 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-aed3fd40-5c50-460d-a2db-a2c535082386 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:24.207691 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-aed3fd40-5c50-460d-a2db-a2c535082386 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:24.209029 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-aed3fd40-5c50-460d-a2db-a2c535082386 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.170040 May 23 12:50:24.209776 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 202/385] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:24 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:24.891007 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c902c8f7-9119-4c68-b3c4-930aaf0559ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:24.892229 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c902c8f7-9119-4c68-b3c4-930aaf0559ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:24.904343 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c902c8f7-9119-4c68-b3c4-930aaf0559ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:24.904789 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c902c8f7-9119-4c68-b3c4-930aaf0559ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:24.905586 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c902c8f7-9119-4c68-b3c4-930aaf0559ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:24.906020 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c902c8f7-9119-4c68-b3c4-930aaf0559ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:25.000636 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4d97bcba-2885-454a-bb42-5e1236eb7f48 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:25.001251 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4d97bcba-2885-454a-bb42-5e1236eb7f48 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:25.007552 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4d97bcba-2885-454a-bb42-5e1236eb7f48 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:25.007992 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4d97bcba-2885-454a-bb42-5e1236eb7f48 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:25.009451 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4d97bcba-2885-454a-bb42-5e1236eb7f48 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:25.009879 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4d97bcba-2885-454a-bb42-5e1236eb7f48 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:25.075686 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c902c8f7-9119-4c68-b3c4-930aaf0559ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:25.083533 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c902c8f7-9119-4c68-b3c4-930aaf0559ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.196348 May 23 12:50:25.084101 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 184/386] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:24 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:25.167258 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4d97bcba-2885-454a-bb42-5e1236eb7f48 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:25.175191 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4d97bcba-2885-454a-bb42-5e1236eb7f48 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.178249 May 23 12:50:25.175765 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 203/387] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:24 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:25.228450 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2233192a-1dff-433e-b8ce-bd18112596d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:25.229172 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2233192a-1dff-433e-b8ce-bd18112596d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:25.235346 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2233192a-1dff-433e-b8ce-bd18112596d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:25.235882 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2233192a-1dff-433e-b8ce-bd18112596d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:25.236710 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2233192a-1dff-433e-b8ce-bd18112596d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:25.237237 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2233192a-1dff-433e-b8ce-bd18112596d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:25.382138 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2233192a-1dff-433e-b8ce-bd18112596d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:25.391204 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2233192a-1dff-433e-b8ce-bd18112596d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:25.392693 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2233192a-1dff-433e-b8ce-bd18112596d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:25.393862 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2233192a-1dff-433e-b8ce-bd18112596d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.169991 May 23 12:50:25.394421 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 185/388] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:25 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:26.101817 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7e5b40f4-1d93-41a9-bd49-d9dd8d3e5d1f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:26.102787 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7e5b40f4-1d93-41a9-bd49-d9dd8d3e5d1f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:26.109094 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e5b40f4-1d93-41a9-bd49-d9dd8d3e5d1f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:26.109565 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e5b40f4-1d93-41a9-bd49-d9dd8d3e5d1f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:26.110321 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e5b40f4-1d93-41a9-bd49-d9dd8d3e5d1f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:26.110747 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e5b40f4-1d93-41a9-bd49-d9dd8d3e5d1f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:26.193592 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6520351f-0f97-4d17-978c-7e76d30e10df tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:26.194425 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6520351f-0f97-4d17-978c-7e76d30e10df tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:26.201975 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6520351f-0f97-4d17-978c-7e76d30e10df tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:26.202613 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6520351f-0f97-4d17-978c-7e76d30e10df tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:26.203542 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6520351f-0f97-4d17-978c-7e76d30e10df tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:26.204416 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6520351f-0f97-4d17-978c-7e76d30e10df tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:26.259104 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7e5b40f4-1d93-41a9-bd49-d9dd8d3e5d1f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:26.268299 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7e5b40f4-1d93-41a9-bd49-d9dd8d3e5d1f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.170201 May 23 12:50:26.269193 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 204/389] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:26 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:26.359974 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6520351f-0f97-4d17-978c-7e76d30e10df tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:26.367558 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6520351f-0f97-4d17-978c-7e76d30e10df tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.177869 May 23 12:50:26.368902 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 186/390] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:26 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:26.412729 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-72e9e758-7b65-4586-852e-bdb2fd3c1c29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:26.413477 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-72e9e758-7b65-4586-852e-bdb2fd3c1c29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:26.420314 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-72e9e758-7b65-4586-852e-bdb2fd3c1c29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:26.420761 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-72e9e758-7b65-4586-852e-bdb2fd3c1c29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:26.421559 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-72e9e758-7b65-4586-852e-bdb2fd3c1c29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:26.421988 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-72e9e758-7b65-4586-852e-bdb2fd3c1c29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:26.558896 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-72e9e758-7b65-4586-852e-bdb2fd3c1c29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:26.568307 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-72e9e758-7b65-4586-852e-bdb2fd3c1c29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:26.569819 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-72e9e758-7b65-4586-852e-bdb2fd3c1c29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:26.572657 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-72e9e758-7b65-4586-852e-bdb2fd3c1c29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.162330 May 23 12:50:26.583224 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 205/391] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:26 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:27.288237 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ef1730b5-47c2-4596-a703-a90faac8c691 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:27.290298 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ef1730b5-47c2-4596-a703-a90faac8c691 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:27.299717 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ef1730b5-47c2-4596-a703-a90faac8c691 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:27.300889 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ef1730b5-47c2-4596-a703-a90faac8c691 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:27.301624 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ef1730b5-47c2-4596-a703-a90faac8c691 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:27.302217 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ef1730b5-47c2-4596-a703-a90faac8c691 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:27.385712 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-49c4af57-9d4a-4a1d-a003-fafee7c55fdc tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:27.386334 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-49c4af57-9d4a-4a1d-a003-fafee7c55fdc tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:27.400051 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-49c4af57-9d4a-4a1d-a003-fafee7c55fdc tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:27.401016 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-49c4af57-9d4a-4a1d-a003-fafee7c55fdc tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:27.402769 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-49c4af57-9d4a-4a1d-a003-fafee7c55fdc tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:27.403676 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-49c4af57-9d4a-4a1d-a003-fafee7c55fdc tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:27.474854 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ef1730b5-47c2-4596-a703-a90faac8c691 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:27.483132 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ef1730b5-47c2-4596-a703-a90faac8c691 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.199453 May 23 12:50:27.484020 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 187/392] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:27 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:27.564020 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-49c4af57-9d4a-4a1d-a003-fafee7c55fdc tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:27.572778 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-49c4af57-9d4a-4a1d-a003-fafee7c55fdc tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.191494 May 23 12:50:27.573400 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 206/393] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:27 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:27.591816 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b1fbdd86-6099-4455-aae7-3abaa4d6050a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:27.592417 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b1fbdd86-6099-4455-aae7-3abaa4d6050a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:27.598643 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b1fbdd86-6099-4455-aae7-3abaa4d6050a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:27.599080 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b1fbdd86-6099-4455-aae7-3abaa4d6050a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:27.599840 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b1fbdd86-6099-4455-aae7-3abaa4d6050a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:27.600260 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b1fbdd86-6099-4455-aae7-3abaa4d6050a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:27.748370 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b1fbdd86-6099-4455-aae7-3abaa4d6050a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:27.757062 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b1fbdd86-6099-4455-aae7-3abaa4d6050a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:27.758696 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b1fbdd86-6099-4455-aae7-3abaa4d6050a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:27.759852 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b1fbdd86-6099-4455-aae7-3abaa4d6050a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.172214 May 23 12:50:27.760553 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 188/394] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:27 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:28.250488 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-aea59e59-44de-45d6-ad24-68a2b3b442d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:28.250891 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-aea59e59-44de-45d6-ad24-68a2b3b442d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:28.252735 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=4 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:28.253408 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=10 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:28.260533 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aea59e59-44de-45d6-ad24-68a2b3b442d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.260975 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aea59e59-44de-45d6-ad24-68a2b3b442d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.261772 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aea59e59-44de-45d6-ad24-68a2b3b442d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.262200 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aea59e59-44de-45d6-ad24-68a2b3b442d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.287445 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-aea59e59-44de-45d6-ad24-68a2b3b442d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451/ips" status: 200 len: 150 microversion: 2.1 time: 0.040758 May 23 12:50:28.290213 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 207/395] 10.222.0.45 () {58 vars in 1247 bytes} [Mon May 23 12:50:28 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:28.307891 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ef331823-329e-4383-a1db-326ccaea9780 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdf05fad-d0d2-4093-87b6-b43db7810fd1"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:28.309287 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ef331823-329e-4383-a1db-326ccaea9780 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:28.316343 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ef331823-329e-4383-a1db-326ccaea9780 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.316777 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ef331823-329e-4383-a1db-326ccaea9780 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.317565 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ef331823-329e-4383-a1db-326ccaea9780 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.317994 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ef331823-329e-4383-a1db-326ccaea9780 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.336362 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:28.407725 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-ef331823-329e-4383-a1db-326ccaea9780 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Invalid volume: volume fdf05fad-d0d2-4093-87b6-b43db7810fd1 is already attached to instances: d6eb03bd-ab37-4dff-9646-6e6213c07618 May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ef331823-329e-4383-a1db-326ccaea9780 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: POST /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451/os-volume_attachments HTTP/1.1 May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 74 May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:50:28.409572 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: {"volumeAttachment": {"volumeId": "fdf05fad-d0d2-4093-87b6-b43db7810fd1"}} May 23 12:50:28.411127 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Invalid volume: volume fdf05fad-d0d2-4093-87b6-b43db7810fd1 is already attached to instances: d6eb03bd-ab37-4dff-9646-6e6213c07618 May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'server_id': '99cc8749-8ab7-419e-8111-8b59e8cdf451', 'body': {'volumeAttachment': {'volumeId': 'fdf05fad-d0d2-4093-87b6-b43db7810fd1'}}} May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fdf05fad-d0d2-4093-87b6-b43db7810fd1 is already attached to instances: d6eb03bd-ab37-4dff-9646-6e6213c07618 May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:50:28.412051 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fdf05fad-d0d2-4093-87b6-b43db7810fd1 is already attached to instances: d6eb03bd-ab37-4dff-9646-6e6213c07618 May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:50:28.413476 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:50:28.414981 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:50:28.414981 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:50:28.414981 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:50:28.414981 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fdf05fad-d0d2-4093-87b6-b43db7810fd1 is already attached to instances: d6eb03bd-ab37-4dff-9646-6e6213c07618 May 23 12:50:28.414981 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:50:28.414981 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ef331823-329e-4383-a1db-326ccaea9780 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 400 to user: Invalid volume: volume fdf05fad-d0d2-4093-87b6-b43db7810fd1 is already attached to instances: d6eb03bd-ab37-4dff-9646-6e6213c07618 {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:50:28.414981 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ef331823-329e-4383-a1db-326ccaea9780 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109030 May 23 12:50:28.415756 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 189/396] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:50:28 2022] POST /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 12:50:28.426185 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-826a6757-620d-4db7-860f-ef231730498f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:28.426774 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-826a6757-620d-4db7-860f-ef231730498f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:28.433929 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-826a6757-620d-4db7-860f-ef231730498f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.434374 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-826a6757-620d-4db7-860f-ef231730498f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.435144 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-826a6757-620d-4db7-860f-ef231730498f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.435764 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-826a6757-620d-4db7-860f-ef231730498f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.463164 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-826a6757-620d-4db7-860f-ef231730498f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:50:28.503639 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b705684d-c318-4836-9321-94b8ae8eb248 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:28.504417 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b705684d-c318-4836-9321-94b8ae8eb248 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:28.512244 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b705684d-c318-4836-9321-94b8ae8eb248 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.512685 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b705684d-c318-4836-9321-94b8ae8eb248 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.513476 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b705684d-c318-4836-9321-94b8ae8eb248 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.514472 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b705684d-c318-4836-9321-94b8ae8eb248 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.556564 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-826a6757-620d-4db7-860f-ef231730498f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 204 len: 0 microversion: 2.1 time: 0.134799 May 23 12:50:28.557452 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 208/397] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:50:28 2022] DELETE /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:50:28.569063 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3ed04528-1afa-4269-a7ad-575dfd59ab9e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:28.569818 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3ed04528-1afa-4269-a7ad-575dfd59ab9e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:28.576713 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ed04528-1afa-4269-a7ad-575dfd59ab9e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.577176 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ed04528-1afa-4269-a7ad-575dfd59ab9e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.577974 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ed04528-1afa-4269-a7ad-575dfd59ab9e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.578401 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ed04528-1afa-4269-a7ad-575dfd59ab9e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.690734 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b705684d-c318-4836-9321-94b8ae8eb248 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:28.700449 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b705684d-c318-4836-9321-94b8ae8eb248 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.203369 May 23 12:50:28.701388 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 190/398] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:28 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:28.706216 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-02272346-c339-4372-b8f2-57ed2c3eb6e6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:28.706964 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-02272346-c339-4372-b8f2-57ed2c3eb6e6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:28.714049 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-02272346-c339-4372-b8f2-57ed2c3eb6e6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.715110 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-02272346-c339-4372-b8f2-57ed2c3eb6e6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.715899 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-02272346-c339-4372-b8f2-57ed2c3eb6e6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.716621 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-02272346-c339-4372-b8f2-57ed2c3eb6e6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.741163 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3ed04528-1afa-4269-a7ad-575dfd59ab9e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:28.750812 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3ed04528-1afa-4269-a7ad-575dfd59ab9e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1682 microversion: 2.1 time: 0.188927 May 23 12:50:28.752911 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 209/399] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:28 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:28.781414 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3b621253-36f6-4afd-9815-bfcb29d436d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:28.783227 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3b621253-36f6-4afd-9815-bfcb29d436d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:28.791806 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3b621253-36f6-4afd-9815-bfcb29d436d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.792715 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3b621253-36f6-4afd-9815-bfcb29d436d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.794430 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3b621253-36f6-4afd-9815-bfcb29d436d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:28.795146 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3b621253-36f6-4afd-9815-bfcb29d436d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:28.901176 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-02272346-c339-4372-b8f2-57ed2c3eb6e6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:28.915115 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-02272346-c339-4372-b8f2-57ed2c3eb6e6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.212152 May 23 12:50:28.915765 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 191/400] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:28 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:28.962368 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3b621253-36f6-4afd-9815-bfcb29d436d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:28.972069 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3b621253-36f6-4afd-9815-bfcb29d436d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:28.973563 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3b621253-36f6-4afd-9815-bfcb29d436d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:28.974702 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3b621253-36f6-4afd-9815-bfcb29d436d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.198086 May 23 12:50:28.975253 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 210/401] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:28 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:29.722146 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9d7f7d4f-a390-4813-9832-3e22fd6f59f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:29.722994 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9d7f7d4f-a390-4813-9832-3e22fd6f59f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:29.730402 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9d7f7d4f-a390-4813-9832-3e22fd6f59f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:29.730914 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9d7f7d4f-a390-4813-9832-3e22fd6f59f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:29.731659 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9d7f7d4f-a390-4813-9832-3e22fd6f59f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:29.732233 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9d7f7d4f-a390-4813-9832-3e22fd6f59f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:29.768740 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e9854a94-afe2-429b-b403-438db9e3bdb6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:29.769717 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e9854a94-afe2-429b-b403-438db9e3bdb6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:29.780898 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9854a94-afe2-429b-b403-438db9e3bdb6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:29.781518 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9854a94-afe2-429b-b403-438db9e3bdb6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:29.785876 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9854a94-afe2-429b-b403-438db9e3bdb6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:29.786382 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9854a94-afe2-429b-b403-438db9e3bdb6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:29.882802 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9d7f7d4f-a390-4813-9832-3e22fd6f59f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:29.890524 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:29.895347 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9d7f7d4f-a390-4813-9832-3e22fd6f59f2 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.179093 May 23 12:50:29.895926 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 192/402] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:29 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:29.932490 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2937c8f7-9800-4308-a3eb-51b933589578 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:29.933102 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2937c8f7-9800-4308-a3eb-51b933589578 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:29.941107 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2937c8f7-9800-4308-a3eb-51b933589578 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:29.942327 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2937c8f7-9800-4308-a3eb-51b933589578 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:29.943121 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2937c8f7-9800-4308-a3eb-51b933589578 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:29.943554 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2937c8f7-9800-4308-a3eb-51b933589578 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:29.954398 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e9854a94-afe2-429b-b403-438db9e3bdb6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:29.963572 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e9854a94-afe2-429b-b403-438db9e3bdb6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1682 microversion: 2.1 time: 0.198317 May 23 12:50:29.973953 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 211/403] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:29 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:29.994681 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-fe6565f0-cd3e-4b09-9c72-9968ebb86004 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:29.995292 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-fe6565f0-cd3e-4b09-9c72-9968ebb86004 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:30.010433 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fe6565f0-cd3e-4b09-9c72-9968ebb86004 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:30.011347 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fe6565f0-cd3e-4b09-9c72-9968ebb86004 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:30.012912 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fe6565f0-cd3e-4b09-9c72-9968ebb86004 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:30.013567 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fe6565f0-cd3e-4b09-9c72-9968ebb86004 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:30.143747 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2937c8f7-9800-4308-a3eb-51b933589578 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:30.151893 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2937c8f7-9800-4308-a3eb-51b933589578 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.223525 May 23 12:50:30.161676 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 193/404] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:29 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:30.180603 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fe6565f0-cd3e-4b09-9c72-9968ebb86004 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:30.190978 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fe6565f0-cd3e-4b09-9c72-9968ebb86004 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:30.192459 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fe6565f0-cd3e-4b09-9c72-9968ebb86004 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:30.193657 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-fe6565f0-cd3e-4b09-9c72-9968ebb86004 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.203837 May 23 12:50:30.194199 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 212/405] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:29 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:30.912422 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-665c3578-a9f1-4009-bed3-af879e1a7d93 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:30.913125 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-665c3578-a9f1-4009-bed3-af879e1a7d93 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:30.921287 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-665c3578-a9f1-4009-bed3-af879e1a7d93 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:30.921805 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-665c3578-a9f1-4009-bed3-af879e1a7d93 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:30.922654 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-665c3578-a9f1-4009-bed3-af879e1a7d93 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:30.923165 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-665c3578-a9f1-4009-bed3-af879e1a7d93 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:30.981950 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6d4ce975-392c-4609-b943-02fee1836e7f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:30.982586 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6d4ce975-392c-4609-b943-02fee1836e7f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:30.989177 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6d4ce975-392c-4609-b943-02fee1836e7f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:30.989673 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6d4ce975-392c-4609-b943-02fee1836e7f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:30.990709 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6d4ce975-392c-4609-b943-02fee1836e7f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:30.991326 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6d4ce975-392c-4609-b943-02fee1836e7f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:31.096590 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-665c3578-a9f1-4009-bed3-af879e1a7d93 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:31.116147 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-665c3578-a9f1-4009-bed3-af879e1a7d93 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.207656 May 23 12:50:31.116733 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 194/406] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:30 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:31.165025 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6d4ce975-392c-4609-b943-02fee1836e7f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:31.173396 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c98afa74-2daa-4825-90bf-154f975aaf05 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:31.174086 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6d4ce975-392c-4609-b943-02fee1836e7f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1682 microversion: 2.1 time: 0.196675 May 23 12:50:31.174221 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c98afa74-2daa-4825-90bf-154f975aaf05 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:31.175349 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 213/407] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:30 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:31.182433 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c98afa74-2daa-4825-90bf-154f975aaf05 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:31.182885 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c98afa74-2daa-4825-90bf-154f975aaf05 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:31.183682 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c98afa74-2daa-4825-90bf-154f975aaf05 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:31.184114 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c98afa74-2daa-4825-90bf-154f975aaf05 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:31.213479 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-98ea2c75-5377-4c68-87d5-552984ea157d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:31.214183 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-98ea2c75-5377-4c68-87d5-552984ea157d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:31.221649 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-98ea2c75-5377-4c68-87d5-552984ea157d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:31.222224 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-98ea2c75-5377-4c68-87d5-552984ea157d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:31.223272 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-98ea2c75-5377-4c68-87d5-552984ea157d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:31.223782 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-98ea2c75-5377-4c68-87d5-552984ea157d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:31.338243 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c98afa74-2daa-4825-90bf-154f975aaf05 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:31.352649 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c98afa74-2daa-4825-90bf-154f975aaf05 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.183125 May 23 12:50:31.362551 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 195/408] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:31 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:31.413408 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-98ea2c75-5377-4c68-87d5-552984ea157d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:31.422856 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-98ea2c75-5377-4c68-87d5-552984ea157d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:31.424188 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-98ea2c75-5377-4c68-87d5-552984ea157d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:31.425380 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-98ea2c75-5377-4c68-87d5-552984ea157d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.216300 May 23 12:50:31.425931 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 214/409] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:31 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:32.134624 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c16107d6-f160-442e-940e-a6ac167be34d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:32.135261 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c16107d6-f160-442e-940e-a6ac167be34d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:32.141749 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c16107d6-f160-442e-940e-a6ac167be34d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:32.142195 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c16107d6-f160-442e-940e-a6ac167be34d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:32.142948 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c16107d6-f160-442e-940e-a6ac167be34d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:32.143379 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c16107d6-f160-442e-940e-a6ac167be34d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:32.193887 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-652ce136-ddb2-405a-924c-419b8313e3c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:32.194582 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-652ce136-ddb2-405a-924c-419b8313e3c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:32.200649 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-652ce136-ddb2-405a-924c-419b8313e3c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:32.201185 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-652ce136-ddb2-405a-924c-419b8313e3c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:32.202022 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-652ce136-ddb2-405a-924c-419b8313e3c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:32.202541 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-652ce136-ddb2-405a-924c-419b8313e3c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:32.278205 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c16107d6-f160-442e-940e-a6ac167be34d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:32.285633 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c16107d6-f160-442e-940e-a6ac167be34d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.155437 May 23 12:50:32.286197 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 196/410] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:32 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:32.331709 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-652ce136-ddb2-405a-924c-419b8313e3c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:32.345369 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-652ce136-ddb2-405a-924c-419b8313e3c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1682 microversion: 2.1 time: 0.149525 May 23 12:50:32.345369 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 215/411] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:32 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:32.371549 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-030dd42d-461c-4d30-9e24-99b96db87bb6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:32.372167 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-030dd42d-461c-4d30-9e24-99b96db87bb6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:32.388647 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-030dd42d-461c-4d30-9e24-99b96db87bb6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:32.389295 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-030dd42d-461c-4d30-9e24-99b96db87bb6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:32.390060 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-030dd42d-461c-4d30-9e24-99b96db87bb6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:32.390603 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-030dd42d-461c-4d30-9e24-99b96db87bb6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:32.442965 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-12a438b8-1e75-41d7-94a7-99b7c3823a66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:32.443669 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-12a438b8-1e75-41d7-94a7-99b7c3823a66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:32.450891 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-12a438b8-1e75-41d7-94a7-99b7c3823a66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:32.451415 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-12a438b8-1e75-41d7-94a7-99b7c3823a66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:32.452270 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-12a438b8-1e75-41d7-94a7-99b7c3823a66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:32.452759 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-12a438b8-1e75-41d7-94a7-99b7c3823a66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:32.549865 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-030dd42d-461c-4d30-9e24-99b96db87bb6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:32.557283 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-030dd42d-461c-4d30-9e24-99b96db87bb6 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.190912 May 23 12:50:32.557859 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 197/412] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:32 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:32.694466 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-12a438b8-1e75-41d7-94a7-99b7c3823a66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:32.703545 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-12a438b8-1e75-41d7-94a7-99b7c3823a66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:32.704998 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-12a438b8-1e75-41d7-94a7-99b7c3823a66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:32.706162 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-12a438b8-1e75-41d7-94a7-99b7c3823a66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.267358 May 23 12:50:32.706714 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 216/413] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:32 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:33.123600 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-be5511db-4f63-41d9-9678-f7602569be01 req-bbf72879-df79-4b96-ad24-4d2ef5950735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b00eae-ec09-4a1b-9987-9044598907c3", "tag": "840097c5-e401-4648-8ecb-639577acce99"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:33.129971 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=8 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:33.137744 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-be5511db-4f63-41d9-9678-f7602569be01 req-bbf72879-df79-4b96-ad24-4d2ef5950735 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:33.139030 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-be5511db-4f63-41d9-9678-f7602569be01 req-bbf72879-df79-4b96-ad24-4d2ef5950735 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:33.153364 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-be5511db-4f63-41d9-9678-f7602569be01 req-bbf72879-df79-4b96-ad24-4d2ef5950735 service nova] Creating event network-changed:840097c5-e401-4648-8ecb-639577acce99 for instance f2b00eae-ec09-4a1b-9987-9044598907c3 on hv-cinder-maste May 23 12:50:33.167781 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-be5511db-4f63-41d9-9678-f7602569be01 req-bbf72879-df79-4b96-ad24-4d2ef5950735 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046869 May 23 12:50:33.168363 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 198/414] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:33.302546 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-aa0deebd-ec33-469e-83f1-1fd1be34f965 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:33.303151 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-aa0deebd-ec33-469e-83f1-1fd1be34f965 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:33.309815 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aa0deebd-ec33-469e-83f1-1fd1be34f965 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:33.310257 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aa0deebd-ec33-469e-83f1-1fd1be34f965 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:33.311011 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aa0deebd-ec33-469e-83f1-1fd1be34f965 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:33.311439 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aa0deebd-ec33-469e-83f1-1fd1be34f965 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:33.315470 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:33.361532 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1ce87e99-2a8d-4234-8ea7-5fbbdeacdc36 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:33.362358 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1ce87e99-2a8d-4234-8ea7-5fbbdeacdc36 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:33.369286 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1ce87e99-2a8d-4234-8ea7-5fbbdeacdc36 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:33.369736 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1ce87e99-2a8d-4234-8ea7-5fbbdeacdc36 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:33.370504 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1ce87e99-2a8d-4234-8ea7-5fbbdeacdc36 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:33.370937 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1ce87e99-2a8d-4234-8ea7-5fbbdeacdc36 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:33.449898 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-aa0deebd-ec33-469e-83f1-1fd1be34f965 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:33.457335 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-aa0deebd-ec33-469e-83f1-1fd1be34f965 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.158643 May 23 12:50:33.457898 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 217/415] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:33 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:33.501185 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-1ce87e99-2a8d-4234-8ea7-5fbbdeacdc36 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:33.508638 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1ce87e99-2a8d-4234-8ea7-5fbbdeacdc36 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1682 microversion: 2.1 time: 0.152693 May 23 12:50:33.509222 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 199/416] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:33 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:33.573490 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f1177a1f-06da-492a-937c-1649eb011da5 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:33.574240 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f1177a1f-06da-492a-937c-1649eb011da5 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:33.584402 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f1177a1f-06da-492a-937c-1649eb011da5 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:33.584841 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f1177a1f-06da-492a-937c-1649eb011da5 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:33.585655 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f1177a1f-06da-492a-937c-1649eb011da5 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:33.586040 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f1177a1f-06da-492a-937c-1649eb011da5 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:33.722124 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f1177a1f-06da-492a-937c-1649eb011da5 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:33.725311 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0ba24e5b-e783-4868-b812-62ceaf51836d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:33.725917 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0ba24e5b-e783-4868-b812-62ceaf51836d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:33.730567 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f1177a1f-06da-492a-937c-1649eb011da5 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.161240 May 23 12:50:33.731302 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 218/417] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:33 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:33.732435 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0ba24e5b-e783-4868-b812-62ceaf51836d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:33.732879 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0ba24e5b-e783-4868-b812-62ceaf51836d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:33.733666 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0ba24e5b-e783-4868-b812-62ceaf51836d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:33.734105 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0ba24e5b-e783-4868-b812-62ceaf51836d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:33.870955 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0ba24e5b-e783-4868-b812-62ceaf51836d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:33.879498 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0ba24e5b-e783-4868-b812-62ceaf51836d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:33.881085 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0ba24e5b-e783-4868-b812-62ceaf51836d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:33.882357 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0ba24e5b-e783-4868-b812-62ceaf51836d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.160938 May 23 12:50:33.883004 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 200/418] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:33 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:34.474873 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-55af462a-098c-448f-8cc6-6064a7c7a7fc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:34.475481 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-55af462a-098c-448f-8cc6-6064a7c7a7fc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:34.482234 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-55af462a-098c-448f-8cc6-6064a7c7a7fc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:34.482678 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-55af462a-098c-448f-8cc6-6064a7c7a7fc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:34.483447 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-55af462a-098c-448f-8cc6-6064a7c7a7fc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:34.483866 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-55af462a-098c-448f-8cc6-6064a7c7a7fc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:34.526078 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-77e8c235-66b0-4160-bbc1-eb7b0651fd12 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:34.526680 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-77e8c235-66b0-4160-bbc1-eb7b0651fd12 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:34.533107 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77e8c235-66b0-4160-bbc1-eb7b0651fd12 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:34.533583 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77e8c235-66b0-4160-bbc1-eb7b0651fd12 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:34.534345 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77e8c235-66b0-4160-bbc1-eb7b0651fd12 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:34.534779 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77e8c235-66b0-4160-bbc1-eb7b0651fd12 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:34.670748 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-77e8c235-66b0-4160-bbc1-eb7b0651fd12 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:34.678558 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-77e8c235-66b0-4160-bbc1-eb7b0651fd12 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1682 microversion: 2.1 time: 0.156739 May 23 12:50:34.679150 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 201/419] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:34 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:34.747032 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0d529cf9-71c6-4760-8c4b-84e8b3c8ab85 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:34.747635 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0d529cf9-71c6-4760-8c4b-84e8b3c8ab85 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:34.753840 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d529cf9-71c6-4760-8c4b-84e8b3c8ab85 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:34.754277 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d529cf9-71c6-4760-8c4b-84e8b3c8ab85 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:34.755031 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d529cf9-71c6-4760-8c4b-84e8b3c8ab85 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:34.755455 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d529cf9-71c6-4760-8c4b-84e8b3c8ab85 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:34.888399 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0d529cf9-71c6-4760-8c4b-84e8b3c8ab85 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:34.895733 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0d529cf9-71c6-4760-8c4b-84e8b3c8ab85 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.152647 May 23 12:50:34.896300 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 202/420] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:34 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:34.901234 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-55af462a-098c-448f-8cc6-6064a7c7a7fc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:34.902099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2122aee3-8ec7-4b9f-b23e-75b2ff34652e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:34.902697 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2122aee3-8ec7-4b9f-b23e-75b2ff34652e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:34.908455 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2122aee3-8ec7-4b9f-b23e-75b2ff34652e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:34.908899 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2122aee3-8ec7-4b9f-b23e-75b2ff34652e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:34.909455 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-55af462a-098c-448f-8cc6-6064a7c7a7fc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.438411 May 23 12:50:34.909684 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2122aee3-8ec7-4b9f-b23e-75b2ff34652e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:34.910048 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 219/421] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:34 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:34.910192 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2122aee3-8ec7-4b9f-b23e-75b2ff34652e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:35.036456 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2122aee3-8ec7-4b9f-b23e-75b2ff34652e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:35.044898 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2122aee3-8ec7-4b9f-b23e-75b2ff34652e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:35.046416 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2122aee3-8ec7-4b9f-b23e-75b2ff34652e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:35.047552 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2122aee3-8ec7-4b9f-b23e-75b2ff34652e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.150176 May 23 12:50:35.048104 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 203/422] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:34 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:35.696059 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5b6102ee-d2ff-41a7-b0b1-19f2e086b655 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:35.696874 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5b6102ee-d2ff-41a7-b0b1-19f2e086b655 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:35.709914 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b6102ee-d2ff-41a7-b0b1-19f2e086b655 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:35.710407 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b6102ee-d2ff-41a7-b0b1-19f2e086b655 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:35.711138 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b6102ee-d2ff-41a7-b0b1-19f2e086b655 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:35.711736 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b6102ee-d2ff-41a7-b0b1-19f2e086b655 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:35.907267 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5b6102ee-d2ff-41a7-b0b1-19f2e086b655 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:35.912359 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-86850b9c-eae5-4059-9d78-09000fa270c1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:35.912970 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-86850b9c-eae5-4059-9d78-09000fa270c1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:35.915679 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5b6102ee-d2ff-41a7-b0b1-19f2e086b655 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1682 microversion: 2.1 time: 0.223534 May 23 12:50:35.916543 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 220/423] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:35 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:35.920443 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-86850b9c-eae5-4059-9d78-09000fa270c1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:35.921173 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-86850b9c-eae5-4059-9d78-09000fa270c1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:35.922401 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-86850b9c-eae5-4059-9d78-09000fa270c1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:35.922937 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-86850b9c-eae5-4059-9d78-09000fa270c1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:35.926392 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e66a2492-e7af-4c1e-ad4d-ec3d8da29649 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:35.927066 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e66a2492-e7af-4c1e-ad4d-ec3d8da29649 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:35.933585 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e66a2492-e7af-4c1e-ad4d-ec3d8da29649 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:35.934033 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e66a2492-e7af-4c1e-ad4d-ec3d8da29649 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:35.934806 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e66a2492-e7af-4c1e-ad4d-ec3d8da29649 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:35.935239 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e66a2492-e7af-4c1e-ad4d-ec3d8da29649 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:36.074668 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e66a2492-e7af-4c1e-ad4d-ec3d8da29649 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:36.082576 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e66a2492-e7af-4c1e-ad4d-ec3d8da29649 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1509 microversion: 2.1 time: 0.159817 May 23 12:50:36.083158 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 221/424] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:35 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:36.097990 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-aeca1373-6035-4665-8d23-bf2e44138eb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:36.098601 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-aeca1373-6035-4665-8d23-bf2e44138eb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:36.105567 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aeca1373-6035-4665-8d23-bf2e44138eb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:36.106069 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aeca1373-6035-4665-8d23-bf2e44138eb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:36.106791 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aeca1373-6035-4665-8d23-bf2e44138eb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:36.107222 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aeca1373-6035-4665-8d23-bf2e44138eb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:36.250963 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-aeca1373-6035-4665-8d23-bf2e44138eb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:36.265263 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-aeca1373-6035-4665-8d23-bf2e44138eb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:36.266846 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-aeca1373-6035-4665-8d23-bf2e44138eb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:36.268015 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-aeca1373-6035-4665-8d23-bf2e44138eb4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.174036 May 23 12:50:36.268612 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 222/425] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:36 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:36.414817 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-86850b9c-eae5-4059-9d78-09000fa270c1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:36.423016 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-86850b9c-eae5-4059-9d78-09000fa270c1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.514353 May 23 12:50:36.432454 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 204/426] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:35 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:36.939357 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5ebed612-798d-4b48-842f-5d7e44c9444b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:36.939967 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5ebed612-798d-4b48-842f-5d7e44c9444b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:36.942315 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-c58ce1e6-6172-46dc-a711-625e08e47afc req-485f1839-d78f-42dd-92e6-e8d017ffc7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cc8749-8ab7-419e-8111-8b59e8cdf451", "name": "network-vif-deleted", "tag": "6c41b3cd-02e2-44a8-9a11-b6a709f9a966"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:36.950556 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:36.957743 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-c58ce1e6-6172-46dc-a711-625e08e47afc req-485f1839-d78f-42dd-92e6-e8d017ffc7fa service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:36.958634 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-c58ce1e6-6172-46dc-a711-625e08e47afc req-485f1839-d78f-42dd-92e6-e8d017ffc7fa service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:36.961168 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5ebed612-798d-4b48-842f-5d7e44c9444b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:36.962868 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5ebed612-798d-4b48-842f-5d7e44c9444b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:36.963849 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5ebed612-798d-4b48-842f-5d7e44c9444b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:36.965584 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5ebed612-798d-4b48-842f-5d7e44c9444b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:36.985430 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-c58ce1e6-6172-46dc-a711-625e08e47afc req-485f1839-d78f-42dd-92e6-e8d017ffc7fa service nova] Creating event network-vif-deleted:6c41b3cd-02e2-44a8-9a11-b6a709f9a966 for instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 on hv-cinder-maste May 23 12:50:37.001605 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-c58ce1e6-6172-46dc-a711-625e08e47afc req-485f1839-d78f-42dd-92e6-e8d017ffc7fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066810 May 23 12:50:37.004255 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 205/427] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:37.080099 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5ebed612-798d-4b48-842f-5d7e44c9444b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:37.090071 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5ebed612-798d-4b48-842f-5d7e44c9444b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1614 microversion: 2.1 time: 0.160272 May 23 12:50:37.091684 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 223/428] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:36 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1614 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:37.106155 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3bcb4c95-d751-4fc9-95b4-8ec64ac7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:37.107127 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3bcb4c95-d751-4fc9-95b4-8ec64ac7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:37.117257 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3bcb4c95-d751-4fc9-95b4-8ec64ac7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:37.118007 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3bcb4c95-d751-4fc9-95b4-8ec64ac7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:37.118784 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3bcb4c95-d751-4fc9-95b4-8ec64ac7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:37.119408 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3bcb4c95-d751-4fc9-95b4-8ec64ac7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:37.280269 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3bcb4c95-d751-4fc9-95b4-8ec64ac7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:37.286615 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2a116ab9-e639-4a81-8208-acb9e4838973 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:37.287945 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2a116ab9-e639-4a81-8208-acb9e4838973 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:37.288884 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3bcb4c95-d751-4fc9-95b4-8ec64ac7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1515 microversion: 2.1 time: 0.187160 May 23 12:50:37.290505 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 206/429] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:37 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:37.297813 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2a116ab9-e639-4a81-8208-acb9e4838973 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:37.299370 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2a116ab9-e639-4a81-8208-acb9e4838973 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:37.302279 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2a116ab9-e639-4a81-8208-acb9e4838973 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:37.303044 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2a116ab9-e639-4a81-8208-acb9e4838973 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:37.440473 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-496f957a-a2f9-4301-8007-772a638cb03d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:37.441487 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-496f957a-a2f9-4301-8007-772a638cb03d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:37.451486 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-496f957a-a2f9-4301-8007-772a638cb03d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:37.452988 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-496f957a-a2f9-4301-8007-772a638cb03d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:37.454941 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-496f957a-a2f9-4301-8007-772a638cb03d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:37.456389 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-496f957a-a2f9-4301-8007-772a638cb03d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:37.553808 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2a116ab9-e639-4a81-8208-acb9e4838973 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:37.568727 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2a116ab9-e639-4a81-8208-acb9e4838973 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:37.571173 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2a116ab9-e639-4a81-8208-acb9e4838973 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:37.580249 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2a116ab9-e639-4a81-8208-acb9e4838973 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.297357 May 23 12:50:37.580871 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 224/430] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:37 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:37.701620 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-496f957a-a2f9-4301-8007-772a638cb03d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:37.709962 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-496f957a-a2f9-4301-8007-772a638cb03d tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.273644 May 23 12:50:37.710529 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 207/431] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:37 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:37.755028 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-103c0203-62cb-4f6a-b57a-af6d5527879f req-e7c061fb-b530-4114-82db-710720a8cc81 admin admin] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:37.757625 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-103c0203-62cb-4f6a-b57a-af6d5527879f req-e7c061fb-b530-4114-82db-710720a8cc81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:37.758354 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-103c0203-62cb-4f6a-b57a-af6d5527879f req-e7c061fb-b530-4114-82db-710720a8cc81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:37.776770 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-103c0203-62cb-4f6a-b57a-af6d5527879f req-e7c061fb-b530-4114-82db-710720a8cc81 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:37.777269 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-103c0203-62cb-4f6a-b57a-af6d5527879f req-e7c061fb-b530-4114-82db-710720a8cc81 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:37.802128 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-103c0203-62cb-4f6a-b57a-af6d5527879f req-e7c061fb-b530-4114-82db-710720a8cc81 admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/fd27d97c-e311-4816-bf63-664ec5fa7137?delete_info=%7B%22file_to_merge%22:%20%22volume-c160fb8f-0469-42a5-b0e7-02c3cae1eeed.fd27d97c-e311-4816-bf63-664ec5fa7137.vhdx%22,%20%22volume_id%22:%20%22c160fb8f-0469-42a5-b0e7-02c3cae1eeed%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.213019 May 23 12:50:37.802751 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 225/432] 10.222.0.55 () {62 vars in 1800 bytes} [Mon May 23 12:50:37 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/fd27d97c-e311-4816-bf63-664ec5fa7137?delete_info=%7B%22file_to_merge%22:%20%22volume-c160fb8f-0469-42a5-b0e7-02c3cae1eeed.fd27d97c-e311-4816-bf63-664ec5fa7137.vhdx%22,%20%22volume_id%22:%20%22c160fb8f-0469-42a5-b0e7-02c3cae1eeed%22%7D => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 12:50:38.109604 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-af7081ad-914c-4bb7-8ab0-07c6ce463e9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:38.111181 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-af7081ad-914c-4bb7-8ab0-07c6ce463e9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:38.123150 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-af7081ad-914c-4bb7-8ab0-07c6ce463e9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:38.126694 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-af7081ad-914c-4bb7-8ab0-07c6ce463e9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:38.130083 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-af7081ad-914c-4bb7-8ab0-07c6ce463e9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:38.131667 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-af7081ad-914c-4bb7-8ab0-07c6ce463e9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:38.260046 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-af7081ad-914c-4bb7-8ab0-07c6ce463e9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:38.282042 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-af7081ad-914c-4bb7-8ab0-07c6ce463e9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1614 microversion: 2.1 time: 0.177502 May 23 12:50:38.293299 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 208/433] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:38 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1614 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:38.608696 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-077d3ea8-d5e3-4915-9931-842db63583c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:38.610189 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-077d3ea8-d5e3-4915-9931-842db63583c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:38.619462 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-077d3ea8-d5e3-4915-9931-842db63583c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:38.620262 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-077d3ea8-d5e3-4915-9931-842db63583c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:38.622378 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-077d3ea8-d5e3-4915-9931-842db63583c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:38.623441 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-077d3ea8-d5e3-4915-9931-842db63583c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:38.730524 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7f28a097-eef8-47ec-bafa-34119e1f2561 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:38.731441 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7f28a097-eef8-47ec-bafa-34119e1f2561 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:38.738737 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f28a097-eef8-47ec-bafa-34119e1f2561 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:38.740046 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f28a097-eef8-47ec-bafa-34119e1f2561 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:38.741129 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f28a097-eef8-47ec-bafa-34119e1f2561 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:38.741675 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7f28a097-eef8-47ec-bafa-34119e1f2561 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:38.893002 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-077d3ea8-d5e3-4915-9931-842db63583c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:38.895956 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-077d3ea8-d5e3-4915-9931-842db63583c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:38.897498 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-077d3ea8-d5e3-4915-9931-842db63583c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:38.898684 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-077d3ea8-d5e3-4915-9931-842db63583c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.302772 May 23 12:50:38.900605 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 226/434] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:38 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:38.907312 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3019f71d-8503-4058-b683-b8346721941d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'create', calling method: .version_select at 0x7f6a36da8940>, body: {"keypair": {"name": "tempest-keypair-691614033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhL0pcEdkz6T7Ui8yvRli+LrayTeCWmCKBJazymQe/QXbmiFkGALd/3Kuz9uGHADIRD5WKQor6p8IMc03JSPdtMDcl1ekead/JDalHKCpyEzxa+J8chgbVfDthMREKugQ=="}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:38.923257 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-3019f71d-8503-4058-b683-b8346721941d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Getting quotas for project 3433fceb10214afcbc819edcec864651. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:50:38.927843 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-3019f71d-8503-4058-b683-b8346721941d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Getting quotas for user e90f349f384245fb8a118be176ad6829 and project 3433fceb10214afcbc819edcec864651. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:50:38.952915 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7f28a097-eef8-47ec-bafa-34119e1f2561 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:38.969758 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7f28a097-eef8-47ec-bafa-34119e1f2561 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.243490 May 23 12:50:38.973198 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 209/435] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:38 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:38.975091 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3019f71d-8503-4058-b683-b8346721941d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073042 May 23 12:50:38.976502 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 227/436] 10.222.0.45 () {60 vars in 1158 bytes} [Mon May 23 12:50:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:39.299810 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-70a76fa1-2fe0-48ba-800c-e83ef106bb90 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:39.300736 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-70a76fa1-2fe0-48ba-800c-e83ef106bb90 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:39.315108 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-70a76fa1-2fe0-48ba-800c-e83ef106bb90 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:39.315838 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-70a76fa1-2fe0-48ba-800c-e83ef106bb90 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:39.316611 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-70a76fa1-2fe0-48ba-800c-e83ef106bb90 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:39.322038 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-70a76fa1-2fe0-48ba-800c-e83ef106bb90 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:39.444272 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-70a76fa1-2fe0-48ba-800c-e83ef106bb90 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:39.454162 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=100 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:39.463069 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-70a76fa1-2fe0-48ba-800c-e83ef106bb90 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1614 microversion: 2.1 time: 0.167024 May 23 12:50:39.477494 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 210/437] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:39 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1614 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:39.918864 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c4731d24-200b-4fa3-9926-607857c1ca1a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:39.919564 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c4731d24-200b-4fa3-9926-607857c1ca1a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:39.926382 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c4731d24-200b-4fa3-9926-607857c1ca1a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:39.927101 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c4731d24-200b-4fa3-9926-607857c1ca1a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:39.928268 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c4731d24-200b-4fa3-9926-607857c1ca1a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:39.928893 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c4731d24-200b-4fa3-9926-607857c1ca1a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:39.989199 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-eb075e65-f544-4347-aca1-c3934c04e7b0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:39.990208 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-eb075e65-f544-4347-aca1-c3934c04e7b0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:39.999927 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eb075e65-f544-4347-aca1-c3934c04e7b0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:40.001703 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eb075e65-f544-4347-aca1-c3934c04e7b0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:40.006375 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eb075e65-f544-4347-aca1-c3934c04e7b0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:40.007068 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eb075e65-f544-4347-aca1-c3934c04e7b0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:40.113797 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c4731d24-200b-4fa3-9926-607857c1ca1a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:40.124230 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c4731d24-200b-4fa3-9926-607857c1ca1a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:40.125988 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c4731d24-200b-4fa3-9926-607857c1ca1a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:40.127335 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c4731d24-200b-4fa3-9926-607857c1ca1a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.213533 May 23 12:50:40.148391 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 228/438] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:39 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:40.365765 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-eb075e65-f544-4347-aca1-c3934c04e7b0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:40.375764 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-eb075e65-f544-4347-aca1-c3934c04e7b0 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.390241 May 23 12:50:40.376404 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 211/439] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:39 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:40.491558 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c6bfea3f-1bc3-48de-9d34-f28d1c19745d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:40.496887 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c6bfea3f-1bc3-48de-9d34-f28d1c19745d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:40.508147 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c6bfea3f-1bc3-48de-9d34-f28d1c19745d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:40.509869 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c6bfea3f-1bc3-48de-9d34-f28d1c19745d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:40.527918 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c6bfea3f-1bc3-48de-9d34-f28d1c19745d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:40.528736 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c6bfea3f-1bc3-48de-9d34-f28d1c19745d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:40.638226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c6bfea3f-1bc3-48de-9d34-f28d1c19745d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:40.652576 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c6bfea3f-1bc3-48de-9d34-f28d1c19745d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1614 microversion: 2.1 time: 0.175282 May 23 12:50:40.654271 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 229/440] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:40 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1614 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:41.158222 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a3f67f4c-5cfd-4745-a877-cf0c191cf3c5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:41.158885 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a3f67f4c-5cfd-4745-a877-cf0c191cf3c5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:41.166456 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a3f67f4c-5cfd-4745-a877-cf0c191cf3c5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:41.168738 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a3f67f4c-5cfd-4745-a877-cf0c191cf3c5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:41.171394 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a3f67f4c-5cfd-4745-a877-cf0c191cf3c5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:41.173027 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a3f67f4c-5cfd-4745-a877-cf0c191cf3c5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:41.188872 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2004756488", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32f19cc5-3dd1-489f-a65f-d2b92995e233"}], "security_groups": [{"name": "tempest-securitygroup--111905766"}], "key_name": "tempest-keypair-691614033", "user_data": "}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:41.416440 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.network.neutron [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] validate_networks() for [('32f19cc5-3dd1-489f-a65f-d2b92995e233', None, None, None, None, None)] {{(pid=134546) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:50:41.500160 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a3f67f4c-5cfd-4745-a877-cf0c191cf3c5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:41.512395 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a3f67f4c-5cfd-4745-a877-cf0c191cf3c5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:41.514608 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a3f67f4c-5cfd-4745-a877-cf0c191cf3c5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:41.516106 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a3f67f4c-5cfd-4745-a877-cf0c191cf3c5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.363392 May 23 12:50:41.517245 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 212/441] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:41 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:41.526397 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6ac79a69-1d4a-49bc-9ee8-f3c1f7097c63 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:41.527347 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6ac79a69-1d4a-49bc-9ee8-f3c1f7097c63 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:41.552712 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6ac79a69-1d4a-49bc-9ee8-f3c1f7097c63 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:41.553651 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6ac79a69-1d4a-49bc-9ee8-f3c1f7097c63 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:41.555816 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6ac79a69-1d4a-49bc-9ee8-f3c1f7097c63 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:41.556425 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6ac79a69-1d4a-49bc-9ee8-f3c1f7097c63 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:41.793057 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6ac79a69-1d4a-49bc-9ee8-f3c1f7097c63 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:41.805111 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6ac79a69-1d4a-49bc-9ee8-f3c1f7097c63 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.286334 May 23 12:50:41.808083 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 213/442] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:41 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:41.815215 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9b6abd76-8e64-464f-ad6f-66e784668743 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:41.816242 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9b6abd76-8e64-464f-ad6f-66e784668743 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:41.824057 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b6abd76-8e64-464f-ad6f-66e784668743 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:41.824981 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b6abd76-8e64-464f-ad6f-66e784668743 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:41.826349 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b6abd76-8e64-464f-ad6f-66e784668743 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:41.827177 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9b6abd76-8e64-464f-ad6f-66e784668743 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:41.920714 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9b6abd76-8e64-464f-ad6f-66e784668743 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:41.932070 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9b6abd76-8e64-464f-ad6f-66e784668743 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1614 microversion: 2.1 time: 0.120217 May 23 12:50:41.932760 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 214/443] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:41 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:42.110476 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Flavor limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:50:42.111274 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Image limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:50:42.111754 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Flavor pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:50:42.112719 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Image pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:50:42.113224 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:50:42.125962 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:42.126497 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:42.127404 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:42.127900 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:42.157188 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Getting quotas for project 3433fceb10214afcbc819edcec864651. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:50:42.162045 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Getting quotas for user e90f349f384245fb8a118be176ad6829 and project 3433fceb10214afcbc819edcec864651. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:50:42.174290 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Going to run 1 instances... {{(pid=134546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:50:42.176852 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:50:42.238017 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1bdfc77e-1d1e-46dd-b2ce-b9da095c0804 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.059157 May 23 12:50:42.240012 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 230/444] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:50:41 2022] POST /compute/v2.1/servers => generated 408 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:50:42.250756 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d4c85c7e-c19e-4436-876b-372872d8dcaf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:42.251870 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d4c85c7e-c19e-4436-876b-372872d8dcaf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:42.346026 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d4c85c7e-c19e-4436-876b-372872d8dcaf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:42.357558 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d4c85c7e-c19e-4436-876b-372872d8dcaf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1245 microversion: 2.1 time: 0.109307 May 23 12:50:42.358191 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 215/445] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:42 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:42.558314 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-328ffb84-6300-4adb-a628-dcc64d53a60e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:42.562425 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-328ffb84-6300-4adb-a628-dcc64d53a60e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:42.579000 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-328ffb84-6300-4adb-a628-dcc64d53a60e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:42.580952 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-328ffb84-6300-4adb-a628-dcc64d53a60e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:42.583008 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-328ffb84-6300-4adb-a628-dcc64d53a60e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:42.583687 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-328ffb84-6300-4adb-a628-dcc64d53a60e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:42.716621 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-876a9754-2bf2-4a37-8e71-2e58e9a01659 req-e7394ceb-e395-4212-bc3a-4acac228950e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b00eae-ec09-4a1b-9987-9044598907c3", "name": "network-vif-plugged", "status": "completed", "tag": "840097c5-e401-4648-8ecb-639577acce99"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:42.746730 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-876a9754-2bf2-4a37-8e71-2e58e9a01659 req-e7394ceb-e395-4212-bc3a-4acac228950e service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:42.747260 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-876a9754-2bf2-4a37-8e71-2e58e9a01659 req-e7394ceb-e395-4212-bc3a-4acac228950e service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:42.783444 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-876a9754-2bf2-4a37-8e71-2e58e9a01659 req-e7394ceb-e395-4212-bc3a-4acac228950e service nova] Creating event network-vif-plugged:840097c5-e401-4648-8ecb-639577acce99 for instance f2b00eae-ec09-4a1b-9987-9044598907c3 on hv-cinder-maste May 23 12:50:42.796655 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-876a9754-2bf2-4a37-8e71-2e58e9a01659 req-e7394ceb-e395-4212-bc3a-4acac228950e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085912 May 23 12:50:42.798644 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 216/446] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:50:42.823445 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-50886b6f-d7e3-4c78-959c-9dd50d1c78de tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:42.824495 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-50886b6f-d7e3-4c78-959c-9dd50d1c78de tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:42.842387 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-50886b6f-d7e3-4c78-959c-9dd50d1c78de tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:42.844382 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-50886b6f-d7e3-4c78-959c-9dd50d1c78de tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:42.849075 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-50886b6f-d7e3-4c78-959c-9dd50d1c78de tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:42.849698 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-50886b6f-d7e3-4c78-959c-9dd50d1c78de tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:42.929184 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-328ffb84-6300-4adb-a628-dcc64d53a60e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:42.944179 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-328ffb84-6300-4adb-a628-dcc64d53a60e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:42.946617 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-328ffb84-6300-4adb-a628-dcc64d53a60e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:42.948522 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-328ffb84-6300-4adb-a628-dcc64d53a60e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.398501 May 23 12:50:42.961971 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 231/447] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:42 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:42.968096 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6456f94d-0b98-4c02-ac27-891a43810cc6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:42.969105 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6456f94d-0b98-4c02-ac27-891a43810cc6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:42.976569 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6456f94d-0b98-4c02-ac27-891a43810cc6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:42.977721 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6456f94d-0b98-4c02-ac27-891a43810cc6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:42.978610 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6456f94d-0b98-4c02-ac27-891a43810cc6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:42.979395 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6456f94d-0b98-4c02-ac27-891a43810cc6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:43.067804 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6456f94d-0b98-4c02-ac27-891a43810cc6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:43.073036 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-50886b6f-d7e3-4c78-959c-9dd50d1c78de tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:43.076205 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6456f94d-0b98-4c02-ac27-891a43810cc6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1614 microversion: 2.1 time: 0.113286 May 23 12:50:43.077054 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 232/448] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:42 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1614 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:43.081268 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-50886b6f-d7e3-4c78-959c-9dd50d1c78de tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.262135 May 23 12:50:43.084521 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 217/449] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:42 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:43.376151 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c0e758d2-fda7-48fd-b27b-b9149390c6b5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:43.378035 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c0e758d2-fda7-48fd-b27b-b9149390c6b5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:43.386835 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c0e758d2-fda7-48fd-b27b-b9149390c6b5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:43.387912 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c0e758d2-fda7-48fd-b27b-b9149390c6b5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:43.389365 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c0e758d2-fda7-48fd-b27b-b9149390c6b5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:43.390363 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c0e758d2-fda7-48fd-b27b-b9149390c6b5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:43.466558 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c0e758d2-fda7-48fd-b27b-b9149390c6b5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:43.478079 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c0e758d2-fda7-48fd-b27b-b9149390c6b5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1249 microversion: 2.1 time: 0.106938 May 23 12:50:43.479281 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 233/450] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:43 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1249 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:43.971102 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b838dd47-42e1-4854-ab3d-f503b92866d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:43.971709 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b838dd47-42e1-4854-ab3d-f503b92866d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:43.979345 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b838dd47-42e1-4854-ab3d-f503b92866d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:43.979784 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b838dd47-42e1-4854-ab3d-f503b92866d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:43.980542 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b838dd47-42e1-4854-ab3d-f503b92866d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:43.980973 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b838dd47-42e1-4854-ab3d-f503b92866d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:44.097480 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6901d7c5-8ad0-41f0-87f6-e851c9ec2473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:44.098472 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6901d7c5-8ad0-41f0-87f6-e851c9ec2473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:44.106310 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6901d7c5-8ad0-41f0-87f6-e851c9ec2473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:44.107136 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6901d7c5-8ad0-41f0-87f6-e851c9ec2473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:44.108115 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6901d7c5-8ad0-41f0-87f6-e851c9ec2473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:44.108583 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6901d7c5-8ad0-41f0-87f6-e851c9ec2473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:44.165688 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b838dd47-42e1-4854-ab3d-f503b92866d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:44.180421 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6901d7c5-8ad0-41f0-87f6-e851c9ec2473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:44.188031 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6901d7c5-8ad0-41f0-87f6-e851c9ec2473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1614 microversion: 2.1 time: 0.095649 May 23 12:50:44.189642 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 234/451] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:44 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:44.193910 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f5d48770-5550-4b8d-b382-ebbbd28b8632 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:44.194514 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f5d48770-5550-4b8d-b382-ebbbd28b8632 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:44.196575 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b838dd47-42e1-4854-ab3d-f503b92866d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:44.199746 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b838dd47-42e1-4854-ab3d-f503b92866d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:44.202487 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b838dd47-42e1-4854-ab3d-f503b92866d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.237801 May 23 12:50:44.204148 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 218/452] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:43 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:44.217048 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5d48770-5550-4b8d-b382-ebbbd28b8632 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:44.217528 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5d48770-5550-4b8d-b382-ebbbd28b8632 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:44.218317 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5d48770-5550-4b8d-b382-ebbbd28b8632 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:44.218755 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5d48770-5550-4b8d-b382-ebbbd28b8632 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:44.387078 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f5d48770-5550-4b8d-b382-ebbbd28b8632 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:44.402790 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f5d48770-5550-4b8d-b382-ebbbd28b8632 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.212346 May 23 12:50:44.403391 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 235/453] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:44 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:44.495860 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-dcecb63f-effe-42b0-bf9e-e49c59e7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:44.496556 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-dcecb63f-effe-42b0-bf9e-e49c59e7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:44.504920 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dcecb63f-effe-42b0-bf9e-e49c59e7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:44.505450 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dcecb63f-effe-42b0-bf9e-e49c59e7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:44.506237 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dcecb63f-effe-42b0-bf9e-e49c59e7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:44.506639 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dcecb63f-effe-42b0-bf9e-e49c59e7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:44.580402 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-dcecb63f-effe-42b0-bf9e-e49c59e7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:44.588433 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-dcecb63f-effe-42b0-bf9e-e49c59e7f679 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1249 microversion: 2.1 time: 0.096746 May 23 12:50:44.589261 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 219/454] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:44 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:45.220733 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6843ecfb-3ef7-4686-ba5a-ac939bacee50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:45.222169 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6843ecfb-3ef7-4686-ba5a-ac939bacee50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:45.223483 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-493c6e65-8c2e-4fe2-bf36-72a818bc445b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:45.224658 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-493c6e65-8c2e-4fe2-bf36-72a818bc445b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:45.229561 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6843ecfb-3ef7-4686-ba5a-ac939bacee50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:45.230012 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6843ecfb-3ef7-4686-ba5a-ac939bacee50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:45.230841 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6843ecfb-3ef7-4686-ba5a-ac939bacee50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:45.231214 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6843ecfb-3ef7-4686-ba5a-ac939bacee50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:45.233793 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-493c6e65-8c2e-4fe2-bf36-72a818bc445b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:45.234648 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-493c6e65-8c2e-4fe2-bf36-72a818bc445b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:45.235890 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-493c6e65-8c2e-4fe2-bf36-72a818bc445b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:45.236582 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-493c6e65-8c2e-4fe2-bf36-72a818bc445b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:45.243627 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=100 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:45.326222 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6843ecfb-3ef7-4686-ba5a-ac939bacee50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:45.340173 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6843ecfb-3ef7-4686-ba5a-ac939bacee50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1614 microversion: 2.1 time: 0.124020 May 23 12:50:45.346270 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 236/455] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:45 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1614 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:45.419622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-493c6e65-8c2e-4fe2-bf36-72a818bc445b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:45.421933 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-90239f00-5241-4cc6-8c84-6b50f0b79b38 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:45.423400 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-90239f00-5241-4cc6-8c84-6b50f0b79b38 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:45.431766 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-493c6e65-8c2e-4fe2-bf36-72a818bc445b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:45.432243 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90239f00-5241-4cc6-8c84-6b50f0b79b38 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:45.432756 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90239f00-5241-4cc6-8c84-6b50f0b79b38 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:45.433309 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-493c6e65-8c2e-4fe2-bf36-72a818bc445b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:45.433713 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90239f00-5241-4cc6-8c84-6b50f0b79b38 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:45.434209 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90239f00-5241-4cc6-8c84-6b50f0b79b38 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:45.434479 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-493c6e65-8c2e-4fe2-bf36-72a818bc445b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.215730 May 23 12:50:45.435045 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 220/456] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:45 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:45.575438 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-90239f00-5241-4cc6-8c84-6b50f0b79b38 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:45.582695 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-90239f00-5241-4cc6-8c84-6b50f0b79b38 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.165719 May 23 12:50:45.583462 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 237/457] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:45 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:45.606159 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3cb9dd40-f63b-45fa-8667-67ee80f4d25e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:45.606777 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3cb9dd40-f63b-45fa-8667-67ee80f4d25e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:45.612858 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3cb9dd40-f63b-45fa-8667-67ee80f4d25e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:45.613336 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3cb9dd40-f63b-45fa-8667-67ee80f4d25e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:45.614099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3cb9dd40-f63b-45fa-8667-67ee80f4d25e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:45.614532 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3cb9dd40-f63b-45fa-8667-67ee80f4d25e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:45.675904 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3cb9dd40-f63b-45fa-8667-67ee80f4d25e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:45.685404 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3cb9dd40-f63b-45fa-8667-67ee80f4d25e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1249 microversion: 2.1 time: 0.083367 May 23 12:50:45.689443 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 221/458] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:45 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:46.366090 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:46.366693 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:46.372868 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:46.373352 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:46.374105 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:46.374530 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:46.404613 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:46.405121 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:46.405525 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lazy-loading 'fault' on Instance uuid 99cc8749-8ab7-419e-8111-8b59e8cdf451 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:50:46.445667 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:46.452078 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e2864215-ab37-4efe-9962-de055e88bb8c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:46.452683 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e2864215-ab37-4efe-9962-de055e88bb8c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:46.453451 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-deab9b6e-104d-4ee8-a136-493c4c00e703 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1331 microversion: 2.1 time: 0.091126 May 23 12:50:46.454026 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 238/459] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:46 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1331 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:46.459105 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2864215-ab37-4efe-9962-de055e88bb8c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:46.459539 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2864215-ab37-4efe-9962-de055e88bb8c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:46.460285 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2864215-ab37-4efe-9962-de055e88bb8c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:46.460710 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2864215-ab37-4efe-9962-de055e88bb8c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:46.592057 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e2864215-ab37-4efe-9962-de055e88bb8c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:46.599903 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-307f249d-9662-43f7-b503-ac05453d42d1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:46.600473 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e2864215-ab37-4efe-9962-de055e88bb8c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:46.600620 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-307f249d-9662-43f7-b503-ac05453d42d1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:46.602048 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e2864215-ab37-4efe-9962-de055e88bb8c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:46.603225 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e2864215-ab37-4efe-9962-de055e88bb8c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.154973 May 23 12:50:46.603781 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 222/460] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:46 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:46.606678 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-307f249d-9662-43f7-b503-ac05453d42d1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:46.607115 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-307f249d-9662-43f7-b503-ac05453d42d1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:46.607865 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-307f249d-9662-43f7-b503-ac05453d42d1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:46.608294 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-307f249d-9662-43f7-b503-ac05453d42d1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:46.702328 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e512b61b-4c15-415a-9bd5-b25cee72a724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:46.703029 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e512b61b-4c15-415a-9bd5-b25cee72a724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:46.708989 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e512b61b-4c15-415a-9bd5-b25cee72a724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:46.709466 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e512b61b-4c15-415a-9bd5-b25cee72a724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:46.710238 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e512b61b-4c15-415a-9bd5-b25cee72a724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:46.710657 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e512b61b-4c15-415a-9bd5-b25cee72a724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:46.738900 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-307f249d-9662-43f7-b503-ac05453d42d1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:46.746911 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-307f249d-9662-43f7-b503-ac05453d42d1 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.150952 May 23 12:50:46.747479 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 239/461] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:46 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:46.771638 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e512b61b-4c15-415a-9bd5-b25cee72a724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:46.780169 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e512b61b-4c15-415a-9bd5-b25cee72a724 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1241 microversion: 2.1 time: 0.081650 May 23 12:50:46.780737 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 223/462] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:46 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:47.471037 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:47.471676 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:47.478340 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:47.478788 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:47.479561 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:47.480001 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:47.510082 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:47.510518 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:47.510959 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lazy-loading 'fault' on Instance uuid 99cc8749-8ab7-419e-8111-8b59e8cdf451 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:50:47.553298 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:47.561744 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-54ea8ce6-67f2-49e7-bdcb-558e32cfe42c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1331 microversion: 2.1 time: 0.094500 May 23 12:50:47.562309 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 240/463] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:47 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:47.621246 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-65823eee-e173-426b-a170-f024898b4518 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:47.621851 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-65823eee-e173-426b-a170-f024898b4518 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:47.627978 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-65823eee-e173-426b-a170-f024898b4518 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:47.628425 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-65823eee-e173-426b-a170-f024898b4518 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:47.629204 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-65823eee-e173-426b-a170-f024898b4518 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:47.629642 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-65823eee-e173-426b-a170-f024898b4518 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:47.757493 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-65823eee-e173-426b-a170-f024898b4518 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:47.763693 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ca04c4dd-c963-4844-8307-2d3c4f9653ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:47.764296 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ca04c4dd-c963-4844-8307-2d3c4f9653ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:47.770376 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca04c4dd-c963-4844-8307-2d3c4f9653ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:47.770527 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-65823eee-e173-426b-a170-f024898b4518 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:47.770829 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca04c4dd-c963-4844-8307-2d3c4f9653ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:47.771594 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca04c4dd-c963-4844-8307-2d3c4f9653ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:47.772000 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-65823eee-e173-426b-a170-f024898b4518 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:47.772119 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca04c4dd-c963-4844-8307-2d3c4f9653ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:47.773171 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-65823eee-e173-426b-a170-f024898b4518 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.155844 May 23 12:50:47.773780 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 224/464] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:47 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:47.796838 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-22dee3e6-dc88-4fb5-a0c8-c57152ad8606 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:47.797605 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-22dee3e6-dc88-4fb5-a0c8-c57152ad8606 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:47.800563 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=100 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:47.804430 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22dee3e6-dc88-4fb5-a0c8-c57152ad8606 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:47.804876 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22dee3e6-dc88-4fb5-a0c8-c57152ad8606 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:47.805711 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22dee3e6-dc88-4fb5-a0c8-c57152ad8606 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:47.806137 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22dee3e6-dc88-4fb5-a0c8-c57152ad8606 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:47.870694 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-22dee3e6-dc88-4fb5-a0c8-c57152ad8606 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:47.877997 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-22dee3e6-dc88-4fb5-a0c8-c57152ad8606 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1241 microversion: 2.1 time: 0.084904 May 23 12:50:47.878562 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 225/465] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:47 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:47.902809 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ca04c4dd-c963-4844-8307-2d3c4f9653ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:47.910136 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ca04c4dd-c963-4844-8307-2d3c4f9653ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.150325 May 23 12:50:47.910689 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 241/466] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:47 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:48.578175 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:48.578810 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:48.584758 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:48.585290 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:48.585983 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:48.587099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:48.617701 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:48.618265 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:48.618717 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lazy-loading 'fault' on Instance uuid 99cc8749-8ab7-419e-8111-8b59e8cdf451 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:50:48.663036 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:48.671129 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b315aa8e-7474-45f6-a17f-92f1ca035056 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1331 microversion: 2.1 time: 0.096843 May 23 12:50:48.671689 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 226/467] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:48 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:48.791848 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9d80dc18-15a1-4f22-9a4d-3e07dc9f2a54 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:48.792445 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-9d80dc18-15a1-4f22-9a4d-3e07dc9f2a54 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:48.798379 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9d80dc18-15a1-4f22-9a4d-3e07dc9f2a54 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:48.798813 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9d80dc18-15a1-4f22-9a4d-3e07dc9f2a54 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:48.799555 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9d80dc18-15a1-4f22-9a4d-3e07dc9f2a54 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:48.799980 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9d80dc18-15a1-4f22-9a4d-3e07dc9f2a54 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:48.895661 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-997ea3d9-7ee2-4687-84d7-238ad2149294 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:48.896612 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-997ea3d9-7ee2-4687-84d7-238ad2149294 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:48.903922 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-997ea3d9-7ee2-4687-84d7-238ad2149294 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:48.904495 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-997ea3d9-7ee2-4687-84d7-238ad2149294 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:48.905392 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-997ea3d9-7ee2-4687-84d7-238ad2149294 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:48.906645 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-997ea3d9-7ee2-4687-84d7-238ad2149294 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:48.968907 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-997ea3d9-7ee2-4687-84d7-238ad2149294 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:48.976479 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-997ea3d9-7ee2-4687-84d7-238ad2149294 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1297 microversion: 2.1 time: 0.086009 May 23 12:50:48.977110 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 227/468] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:48 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:48.981624 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3463660e-4ef0-432f-a545-75f541496c97 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:48.982229 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3463660e-4ef0-432f-a545-75f541496c97 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:48.987214 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9d80dc18-15a1-4f22-9a4d-3e07dc9f2a54 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:48.989043 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3463660e-4ef0-432f-a545-75f541496c97 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:48.989516 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3463660e-4ef0-432f-a545-75f541496c97 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:48.990276 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3463660e-4ef0-432f-a545-75f541496c97 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:48.990711 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3463660e-4ef0-432f-a545-75f541496c97 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:48.995780 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9d80dc18-15a1-4f22-9a4d-3e07dc9f2a54 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:48.997757 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9d80dc18-15a1-4f22-9a4d-3e07dc9f2a54 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:48.998992 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-9d80dc18-15a1-4f22-9a4d-3e07dc9f2a54 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.211225 May 23 12:50:48.999626 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 242/469] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:48 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:49.127063 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3463660e-4ef0-432f-a545-75f541496c97 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:49.130543 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=100 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:49.136481 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3463660e-4ef0-432f-a545-75f541496c97 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.158376 May 23 12:50:49.137039 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 228/470] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:48 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:49.688003 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:49.688603 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:49.694724 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:49.695161 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:49.696103 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:49.696846 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:49.731218 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:49.731781 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:49.732092 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lazy-loading 'fault' on Instance uuid 99cc8749-8ab7-419e-8111-8b59e8cdf451 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:50:49.772376 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:49.779924 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a64f04e9-5cac-44d9-9242-b42b50fa706f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 200 len: 1331 microversion: 2.1 time: 0.096006 May 23 12:50:49.780511 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 243/471] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:49 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:49.818936 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-bf9be59c-7880-47bb-bcc3-b0cb6767f48e tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:49.819456 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-bf9be59c-7880-47bb-bcc3-b0cb6767f48e tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:49.825925 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bf9be59c-7880-47bb-bcc3-b0cb6767f48e tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:49.826369 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bf9be59c-7880-47bb-bcc3-b0cb6767f48e tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:49.827121 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bf9be59c-7880-47bb-bcc3-b0cb6767f48e tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:49.827547 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bf9be59c-7880-47bb-bcc3-b0cb6767f48e tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:49.951522 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-bf9be59c-7880-47bb-bcc3-b0cb6767f48e tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lazy-loading 'services' on Instance uuid c5c71c1d-673e-4a94-92c0-77b702758ea1 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:50:49.993570 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f2803983-6251-49a7-a795-d7ea679013b4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:49.994200 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f2803983-6251-49a7-a795-d7ea679013b4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:49.999989 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f2803983-6251-49a7-a795-d7ea679013b4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:50.000423 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f2803983-6251-49a7-a795-d7ea679013b4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:50.001182 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f2803983-6251-49a7-a795-d7ea679013b4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:50.001616 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f2803983-6251-49a7-a795-d7ea679013b4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:50.072800 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f2803983-6251-49a7-a795-d7ea679013b4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:50.081572 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f2803983-6251-49a7-a795-d7ea679013b4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1297 microversion: 2.1 time: 0.092057 May 23 12:50:50.092025 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-bf9be59c-7880-47bb-bcc3-b0cb6767f48e tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1/os-volume_attachments/c160fb8f-0469-42a5-b0e7-02c3cae1eeed" status: 202 len: 0 microversion: 2.1 time: 0.267841 May 23 12:50:50.092025 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 229/472] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:50:49 2022] DELETE /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1/os-volume_attachments/c160fb8f-0469-42a5-b0e7-02c3cae1eeed => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:50:50.092935 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 244/473] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:49 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:50.103137 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-30f10284-b2b9-4b00-8be5-9c64fb6c5796 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:50.104122 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-30f10284-b2b9-4b00-8be5-9c64fb6c5796 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:50.112048 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-30f10284-b2b9-4b00-8be5-9c64fb6c5796 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:50.112779 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-30f10284-b2b9-4b00-8be5-9c64fb6c5796 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:50.114033 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-30f10284-b2b9-4b00-8be5-9c64fb6c5796 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:50.114639 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-30f10284-b2b9-4b00-8be5-9c64fb6c5796 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:50.154548 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4555768d-cd0c-4ac9-ae04-00d519bfed32 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:50.155169 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4555768d-cd0c-4ac9-ae04-00d519bfed32 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:50.161653 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4555768d-cd0c-4ac9-ae04-00d519bfed32 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:50.162371 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4555768d-cd0c-4ac9-ae04-00d519bfed32 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:50.163320 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4555768d-cd0c-4ac9-ae04-00d519bfed32 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:50.163914 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4555768d-cd0c-4ac9-ae04-00d519bfed32 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:50.397220 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4555768d-cd0c-4ac9-ae04-00d519bfed32 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:50.400873 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-30f10284-b2b9-4b00-8be5-9c64fb6c5796 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:50.405917 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4555768d-cd0c-4ac9-ae04-00d519bfed32 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1358 microversion: 2.1 time: 0.255296 May 23 12:50:50.406489 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 245/474] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:50 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:50.409101 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-30f10284-b2b9-4b00-8be5-9c64fb6c5796 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:50.410602 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-30f10284-b2b9-4b00-8be5-9c64fb6c5796 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:50.411728 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-30f10284-b2b9-4b00-8be5-9c64fb6c5796 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.325564 May 23 12:50:50.412267 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 230/475] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:50 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:50.797454 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-107aed60-164e-42bf-8024-ff4063def918 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:50.798050 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-107aed60-164e-42bf-8024-ff4063def918 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:50.804056 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-107aed60-164e-42bf-8024-ff4063def918 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:50.804435 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-107aed60-164e-42bf-8024-ff4063def918 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:50.805423 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-107aed60-164e-42bf-8024-ff4063def918 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:50.806038 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-107aed60-164e-42bf-8024-ff4063def918 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:50.819195 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-107aed60-164e-42bf-8024-ff4063def918 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-107aed60-164e-42bf-8024-ff4063def918 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 HTTP/1.1 May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:50:50.820922 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:50:50.822615 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': '99cc8749-8ab7-419e-8111-8b59e8cdf451'} May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:50:50.823543 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:50:50.825030 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:50:50.826407 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-107aed60-164e-42bf-8024-ff4063def918 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:50:50.826407 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-107aed60-164e-42bf-8024-ff4063def918 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 404 len: 111 microversion: 2.1 time: 0.028986 May 23 12:50:50.826407 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 246/476] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:50 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:50:50.831667 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-dbbf0d27-b126-4465-9e09-867149358fbf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '.version_select at 0x7f6a375e08b0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:50.863536 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-dbbf0d27-b126-4465-9e09-867149358fbf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-669597574" status: 202 len: 0 microversion: 2.1 time: 0.035544 May 23 12:50:50.864089 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 231/477] 10.222.0.45 () {58 vars in 1217 bytes} [Mon May 23 12:50:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-669597574 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:50:51.099569 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-efabe6a1-7aea-474a-b06d-eef68d4c8457 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:51.100784 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-efabe6a1-7aea-474a-b06d-eef68d4c8457 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:51.111473 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-efabe6a1-7aea-474a-b06d-eef68d4c8457 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.113051 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-efabe6a1-7aea-474a-b06d-eef68d4c8457 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.113869 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-efabe6a1-7aea-474a-b06d-eef68d4c8457 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.114560 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-efabe6a1-7aea-474a-b06d-eef68d4c8457 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.193536 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-efabe6a1-7aea-474a-b06d-eef68d4c8457 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:51.203887 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-efabe6a1-7aea-474a-b06d-eef68d4c8457 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1303 microversion: 2.1 time: 0.107763 May 23 12:50:51.205036 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 247/478] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:51 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:51.423468 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b57d09fa-9857-41c0-b32d-b5588ece1215 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:51.424483 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b57d09fa-9857-41c0-b32d-b5588ece1215 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:51.430531 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d9ada2b8-bdd0-4ccf-be74-7e0a065b8031 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:51.431606 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d9ada2b8-bdd0-4ccf-be74-7e0a065b8031 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:51.444654 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b57d09fa-9857-41c0-b32d-b5588ece1215 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.447482 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d9ada2b8-bdd0-4ccf-be74-7e0a065b8031 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.447994 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b57d09fa-9857-41c0-b32d-b5588ece1215 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.448832 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b57d09fa-9857-41c0-b32d-b5588ece1215 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.449295 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b57d09fa-9857-41c0-b32d-b5588ece1215 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.449930 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d9ada2b8-bdd0-4ccf-be74-7e0a065b8031 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.450923 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d9ada2b8-bdd0-4ccf-be74-7e0a065b8031 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.453182 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d9ada2b8-bdd0-4ccf-be74-7e0a065b8031 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.699298 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d9ada2b8-bdd0-4ccf-be74-7e0a065b8031 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:51.708215 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b57d09fa-9857-41c0-b32d-b5588ece1215 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:51.713084 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d9ada2b8-bdd0-4ccf-be74-7e0a065b8031 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:51.714855 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d9ada2b8-bdd0-4ccf-be74-7e0a065b8031 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:51.716114 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d9ada2b8-bdd0-4ccf-be74-7e0a065b8031 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.289862 May 23 12:50:51.717753 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b57d09fa-9857-41c0-b32d-b5588ece1215 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1548 microversion: 2.1 time: 0.298254 May 23 12:50:51.718686 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 232/479] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:51 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1548 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:51.721854 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 248/480] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:51 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:51.735631 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-875643a8-47fa-4eae-9797-8da94ecb0948 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:51.736243 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-875643a8-47fa-4eae-9797-8da94ecb0948 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:51.743144 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-875643a8-47fa-4eae-9797-8da94ecb0948 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.743853 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-875643a8-47fa-4eae-9797-8da94ecb0948 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.745320 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-875643a8-47fa-4eae-9797-8da94ecb0948 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.745618 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-875643a8-47fa-4eae-9797-8da94ecb0948 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.778121 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-84f5b2f7-cac9-425c-b04d-ed8fee260f26 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:51.778972 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-84f5b2f7-cac9-425c-b04d-ed8fee260f26 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:51.785111 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-84f5b2f7-cac9-425c-b04d-ed8fee260f26 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.785598 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-84f5b2f7-cac9-425c-b04d-ed8fee260f26 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.786355 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-84f5b2f7-cac9-425c-b04d-ed8fee260f26 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.786782 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-84f5b2f7-cac9-425c-b04d-ed8fee260f26 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.888051 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-875643a8-47fa-4eae-9797-8da94ecb0948 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:51.895809 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-875643a8-47fa-4eae-9797-8da94ecb0948 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1548 microversion: 2.1 time: 0.164307 May 23 12:50:51.896551 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 233/481] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:51 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:51.911970 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c6974ae3-dffb-4906-b333-517f7835b4cf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:51.916086 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c6974ae3-dffb-4906-b333-517f7835b4cf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:51.917307 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c6974ae3-dffb-4906-b333-517f7835b4cf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Searching by: {'deleted': False, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1'} {{(pid=134547) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 23 12:50:51.924371 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c6974ae3-dffb-4906-b333-517f7835b4cf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.924886 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c6974ae3-dffb-4906-b333-517f7835b4cf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.925806 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c6974ae3-dffb-4906-b333-517f7835b4cf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:51.926235 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c6974ae3-dffb-4906-b333-517f7835b4cf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:51.933134 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-84f5b2f7-cac9-425c-b04d-ed8fee260f26 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lazy-loading 'services' on Instance uuid d6eb03bd-ab37-4dff-9646-6e6213c07618 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:50:52.031915 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.multi_cell_list [None req-c6974ae3-dffb-4906-b333-517f7835b4cf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 23 12:50:52.118404 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-84f5b2f7-cac9-425c-b04d-ed8fee260f26 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments/fdf05fad-d0d2-4093-87b6-b43db7810fd1" status: 202 len: 0 microversion: 2.1 time: 0.344086 May 23 12:50:52.119218 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 249/482] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:50:51 2022] DELETE /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments/fdf05fad-d0d2-4093-87b6-b43db7810fd1 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 12:50:52.132310 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6552bfbf-ee1b-4d7b-9106-f51cdce378bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:52.136483 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6552bfbf-ee1b-4d7b-9106-f51cdce378bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:52.144329 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=4 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:52.146890 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6552bfbf-ee1b-4d7b-9106-f51cdce378bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.147507 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6552bfbf-ee1b-4d7b-9106-f51cdce378bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.148568 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6552bfbf-ee1b-4d7b-9106-f51cdce378bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.152849 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6552bfbf-ee1b-4d7b-9106-f51cdce378bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.187680 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=10 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:52.193315 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c6974ae3-dffb-4906-b333-517f7835b4cf tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.284968 May 23 12:50:52.194541 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 234/483] 10.222.0.45 () {58 vars in 1124 bytes} [Mon May 23 12:50:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:50:52.217923 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-22d44f95-319f-4925-a082-c164bf675a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:52.218641 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-22d44f95-319f-4925-a082-c164bf675a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:52.231341 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6552bfbf-ee1b-4d7b-9106-f51cdce378bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103189 May 23 12:50:52.234639 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22d44f95-319f-4925-a082-c164bf675a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.236068 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22d44f95-319f-4925-a082-c164bf675a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.240042 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 250/484] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:50:52 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:52.253204 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22d44f95-319f-4925-a082-c164bf675a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.254554 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22d44f95-319f-4925-a082-c164bf675a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.264285 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-04cfa1de-7ff8-40fd-908e-93b2c23f8108 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:52.270195 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-04cfa1de-7ff8-40fd-908e-93b2c23f8108 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:52.291306 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-04cfa1de-7ff8-40fd-908e-93b2c23f8108 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.291981 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-04cfa1de-7ff8-40fd-908e-93b2c23f8108 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.298346 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-04cfa1de-7ff8-40fd-908e-93b2c23f8108 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.299071 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-04cfa1de-7ff8-40fd-908e-93b2c23f8108 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.355119 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:52.515456 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-22d44f95-319f-4925-a082-c164bf675a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:52.523451 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-22d44f95-319f-4925-a082-c164bf675a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1548 microversion: 2.1 time: 0.317605 May 23 12:50:52.525300 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 235/485] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:52 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1548 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:52.541658 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a614ee3b-d991-4cd2-8970-e4c7ec3ddc4b tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:52.542359 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a614ee3b-d991-4cd2-8970-e4c7ec3ddc4b tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:52.549406 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a614ee3b-d991-4cd2-8970-e4c7ec3ddc4b tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.550329 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a614ee3b-d991-4cd2-8970-e4c7ec3ddc4b tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.551457 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a614ee3b-d991-4cd2-8970-e4c7ec3ddc4b tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.552153 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a614ee3b-d991-4cd2-8970-e4c7ec3ddc4b tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.582813 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a614ee3b-d991-4cd2-8970-e4c7ec3ddc4b tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Going to try to terminate instance {{(pid=134547) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:50:52.636907 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-04cfa1de-7ff8-40fd-908e-93b2c23f8108 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:52.640859 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:52.649333 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-04cfa1de-7ff8-40fd-908e-93b2c23f8108 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.399855 May 23 12:50:52.652196 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 251/486] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:52 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:52.697390 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-01c5f03d-a36c-49ae-8556-f4377a3019be req-7891a6f5-9d96-4884-bbec-af242eb4e3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c365608-41a1-4663-b5e2-3481874a2325", "name": "network-vif-plugged", "status": "completed", "tag": "fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:52.705902 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a614ee3b-d991-4cd2-8970-e4c7ec3ddc4b tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 204 len: 0 microversion: 2.1 time: 0.167557 May 23 12:50:52.712780 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 236/487] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:50:52 2022] DELETE /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:50:52.718467 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-01c5f03d-a36c-49ae-8556-f4377a3019be req-7891a6f5-9d96-4884-bbec-af242eb4e3e6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.718872 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-01c5f03d-a36c-49ae-8556-f4377a3019be req-7891a6f5-9d96-4884-bbec-af242eb4e3e6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.721933 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-59101c34-d6ea-4bcb-bf00-d08a1de3fc6c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:52.723080 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-59101c34-d6ea-4bcb-bf00-d08a1de3fc6c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:52.731589 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-59101c34-d6ea-4bcb-bf00-d08a1de3fc6c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.731589 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-59101c34-d6ea-4bcb-bf00-d08a1de3fc6c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.732126 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-59101c34-d6ea-4bcb-bf00-d08a1de3fc6c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.732617 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-59101c34-d6ea-4bcb-bf00-d08a1de3fc6c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.756382 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-01c5f03d-a36c-49ae-8556-f4377a3019be req-7891a6f5-9d96-4884-bbec-af242eb4e3e6 service nova] Creating event network-vif-plugged:fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1 for instance 0c365608-41a1-4663-b5e2-3481874a2325 on hv-cinder-maste May 23 12:50:52.770437 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-01c5f03d-a36c-49ae-8556-f4377a3019be req-7891a6f5-9d96-4884-bbec-af242eb4e3e6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077594 May 23 12:50:52.771341 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 252/488] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:52.778713 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-efa860db-808c-45ce-a323-1cf046064999 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:52.779086 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-efa860db-808c-45ce-a323-1cf046064999 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:52.795894 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-efa860db-808c-45ce-a323-1cf046064999 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.796254 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-efa860db-808c-45ce-a323-1cf046064999 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.797109 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-efa860db-808c-45ce-a323-1cf046064999 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:52.797866 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-efa860db-808c-45ce-a323-1cf046064999 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:52.913642 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-59101c34-d6ea-4bcb-bf00-d08a1de3fc6c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:52.923928 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-59101c34-d6ea-4bcb-bf00-d08a1de3fc6c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1513 microversion: 2.1 time: 0.209449 May 23 12:50:52.925024 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 237/489] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:52 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:53.176711 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-efa860db-808c-45ce-a323-1cf046064999 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:53.187407 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-efa860db-808c-45ce-a323-1cf046064999 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:53.188921 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-efa860db-808c-45ce-a323-1cf046064999 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:53.190198 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-efa860db-808c-45ce-a323-1cf046064999 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.417757 May 23 12:50:53.191532 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 253/490] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:52 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:53.248328 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7028074c-0ab3-43bb-8329-52ac15323702 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:53.249686 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7028074c-0ab3-43bb-8329-52ac15323702 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:53.256899 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7028074c-0ab3-43bb-8329-52ac15323702 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:53.257707 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7028074c-0ab3-43bb-8329-52ac15323702 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:53.259664 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7028074c-0ab3-43bb-8329-52ac15323702 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:53.260366 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7028074c-0ab3-43bb-8329-52ac15323702 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:53.294411 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7028074c-0ab3-43bb-8329-52ac15323702 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051152 May 23 12:50:53.295179 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 238/491] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:50:53 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:53.416393 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-134d9699-a970-4e5f-a9c7-4b3e17e390f4 req-1a2008c0-dc5f-4a62-9dfc-2a5cc4ade705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a42629-21e9-4985-9f40-50fcb8ac70a5", "tag": "60f89927-1069-4785-bbc6-46be1dcf99aa"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:53.424811 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-134d9699-a970-4e5f-a9c7-4b3e17e390f4 req-1a2008c0-dc5f-4a62-9dfc-2a5cc4ade705 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:53.425602 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-134d9699-a970-4e5f-a9c7-4b3e17e390f4 req-1a2008c0-dc5f-4a62-9dfc-2a5cc4ade705 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:53.436826 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-134d9699-a970-4e5f-a9c7-4b3e17e390f4 req-1a2008c0-dc5f-4a62-9dfc-2a5cc4ade705 service nova] Creating event network-changed:60f89927-1069-4785-bbc6-46be1dcf99aa for instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 on hv-cinder-maste May 23 12:50:53.442393 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-134d9699-a970-4e5f-a9c7-4b3e17e390f4 req-1a2008c0-dc5f-4a62-9dfc-2a5cc4ade705 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030081 May 23 12:50:53.443061 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 254/492] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:53.668590 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-4e211a21-9832-451f-95e5-fbb417b6796f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:53.669122 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-4e211a21-9832-451f-95e5-fbb417b6796f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:53.675003 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4e211a21-9832-451f-95e5-fbb417b6796f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:53.675444 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4e211a21-9832-451f-95e5-fbb417b6796f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:53.676191 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4e211a21-9832-451f-95e5-fbb417b6796f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:53.676619 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4e211a21-9832-451f-95e5-fbb417b6796f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:53.805055 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-4e211a21-9832-451f-95e5-fbb417b6796f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:53.812524 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-4e211a21-9832-451f-95e5-fbb417b6796f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.148667 May 23 12:50:53.813080 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 239/493] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:53 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:53.942675 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4a8a787f-a1a8-475e-85a6-af273365a86c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:53.943295 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4a8a787f-a1a8-475e-85a6-af273365a86c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:53.949533 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4a8a787f-a1a8-475e-85a6-af273365a86c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:53.949978 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4a8a787f-a1a8-475e-85a6-af273365a86c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:53.950732 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4a8a787f-a1a8-475e-85a6-af273365a86c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:53.951157 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4a8a787f-a1a8-475e-85a6-af273365a86c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:54.084606 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4a8a787f-a1a8-475e-85a6-af273365a86c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:54.092420 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4a8a787f-a1a8-475e-85a6-af273365a86c tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1513 microversion: 2.1 time: 0.153938 May 23 12:50:54.093285 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 255/494] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:53 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:54.211173 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2d57689c-4383-49b4-919d-17e7cb652986 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:54.212031 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2d57689c-4383-49b4-919d-17e7cb652986 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:54.218817 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2d57689c-4383-49b4-919d-17e7cb652986 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:54.219256 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2d57689c-4383-49b4-919d-17e7cb652986 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:54.220008 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2d57689c-4383-49b4-919d-17e7cb652986 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:54.220433 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2d57689c-4383-49b4-919d-17e7cb652986 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:54.229953 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f7e5e2ca-c811-4b85-b3bc-b6b70340015a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f16474c-ac31-4d53-ada8-9d04a63045b5"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:54.230998 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f7e5e2ca-c811-4b85-b3bc-b6b70340015a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:54.236885 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7e5e2ca-c811-4b85-b3bc-b6b70340015a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:54.237356 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7e5e2ca-c811-4b85-b3bc-b6b70340015a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:54.238103 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7e5e2ca-c811-4b85-b3bc-b6b70340015a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:54.238529 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7e5e2ca-c811-4b85-b3bc-b6b70340015a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:54.353085 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2d57689c-4383-49b4-919d-17e7cb652986 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:54.361389 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2d57689c-4383-49b4-919d-17e7cb652986 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:54.362887 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2d57689c-4383-49b4-919d-17e7cb652986 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:54.364031 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2d57689c-4383-49b4-919d-17e7cb652986 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.156732 May 23 12:50:54.364590 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 240/495] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:54 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:54.369958 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-22c48c38-515d-4e75-b7fc-9bce1fb74586 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:54.370922 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-22c48c38-515d-4e75-b7fc-9bce1fb74586 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:54.376589 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22c48c38-515d-4e75-b7fc-9bce1fb74586 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:54.377041 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22c48c38-515d-4e75-b7fc-9bce1fb74586 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:54.377828 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22c48c38-515d-4e75-b7fc-9bce1fb74586 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:54.378270 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-22c48c38-515d-4e75-b7fc-9bce1fb74586 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:54.407776 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-22c48c38-515d-4e75-b7fc-9bce1fb74586 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 May 23 12:50:54.408334 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 241/496] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:50:54 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:54.828873 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-4b3c123e-f2b7-4b9d-ab47-117165abd5cf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:54.829510 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-4b3c123e-f2b7-4b9d-ab47-117165abd5cf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:54.835799 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b3c123e-f2b7-4b9d-ab47-117165abd5cf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:54.836411 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b3c123e-f2b7-4b9d-ab47-117165abd5cf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:54.837340 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b3c123e-f2b7-4b9d-ab47-117165abd5cf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:54.837782 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b3c123e-f2b7-4b9d-ab47-117165abd5cf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:55.186837 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-4b3c123e-f2b7-4b9d-ab47-117165abd5cf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:55.194491 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-4b3c123e-f2b7-4b9d-ab47-117165abd5cf tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.370009 May 23 12:50:55.195082 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 242/497] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:54 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:55.200985 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5d23e53d-027f-4461-a2e9-c7ef4fa7a583 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:55.200985 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5d23e53d-027f-4461-a2e9-c7ef4fa7a583 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:55.206621 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d23e53d-027f-4461-a2e9-c7ef4fa7a583 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:55.207065 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d23e53d-027f-4461-a2e9-c7ef4fa7a583 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:55.207803 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d23e53d-027f-4461-a2e9-c7ef4fa7a583 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:55.208229 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d23e53d-027f-4461-a2e9-c7ef4fa7a583 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:55.336681 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5d23e53d-027f-4461-a2e9-c7ef4fa7a583 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:55.340536 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:55.345838 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5d23e53d-027f-4461-a2e9-c7ef4fa7a583 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1513 microversion: 2.1 time: 0.149511 May 23 12:50:55.346414 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 243/498] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:55 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:55.382295 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c26847af-6181-4a3a-b907-df73001e3435 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:55.382938 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c26847af-6181-4a3a-b907-df73001e3435 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:55.390922 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c26847af-6181-4a3a-b907-df73001e3435 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:55.391313 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c26847af-6181-4a3a-b907-df73001e3435 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:55.392070 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c26847af-6181-4a3a-b907-df73001e3435 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:55.392497 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c26847af-6181-4a3a-b907-df73001e3435 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:55.524238 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c26847af-6181-4a3a-b907-df73001e3435 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:55.532447 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c26847af-6181-4a3a-b907-df73001e3435 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:55.533966 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c26847af-6181-4a3a-b907-df73001e3435 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:55.535106 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c26847af-6181-4a3a-b907-df73001e3435 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.156502 May 23 12:50:55.535663 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 244/499] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:55 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:55.540739 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-091c332b-6e9f-4c89-a926-3d2d699653b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:55.541708 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-091c332b-6e9f-4c89-a926-3d2d699653b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:55.547224 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-091c332b-6e9f-4c89-a926-3d2d699653b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:55.547664 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-091c332b-6e9f-4c89-a926-3d2d699653b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:55.548406 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-091c332b-6e9f-4c89-a926-3d2d699653b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:55.548827 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-091c332b-6e9f-4c89-a926-3d2d699653b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:55.576974 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-091c332b-6e9f-4c89-a926-3d2d699653b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040346 May 23 12:50:55.577538 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 245/500] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:50:55 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:56.212223 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-84b61ca2-be37-4f2e-927d-2b500c73f30d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:56.212829 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-84b61ca2-be37-4f2e-927d-2b500c73f30d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:56.219154 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-84b61ca2-be37-4f2e-927d-2b500c73f30d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:56.219599 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-84b61ca2-be37-4f2e-927d-2b500c73f30d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:56.220352 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-84b61ca2-be37-4f2e-927d-2b500c73f30d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:56.220792 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-84b61ca2-be37-4f2e-927d-2b500c73f30d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:56.346699 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-84b61ca2-be37-4f2e-927d-2b500c73f30d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:56.354646 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-84b61ca2-be37-4f2e-927d-2b500c73f30d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.146852 May 23 12:50:56.355216 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 246/501] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:56 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:56.362332 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e39e26b3-115c-4a80-84d5-20d6e9107e96 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:56.363012 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e39e26b3-115c-4a80-84d5-20d6e9107e96 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:56.369601 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e39e26b3-115c-4a80-84d5-20d6e9107e96 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:56.370038 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e39e26b3-115c-4a80-84d5-20d6e9107e96 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:56.370787 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e39e26b3-115c-4a80-84d5-20d6e9107e96 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:56.371215 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e39e26b3-115c-4a80-84d5-20d6e9107e96 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:56.496556 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e39e26b3-115c-4a80-84d5-20d6e9107e96 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:56.503971 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e39e26b3-115c-4a80-84d5-20d6e9107e96 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1513 microversion: 2.1 time: 0.145161 May 23 12:50:56.504531 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 247/502] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:56 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:56.553160 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-dfd44fad-39d0-49cd-beb8-5295108d3dac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:56.553774 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-dfd44fad-39d0-49cd-beb8-5295108d3dac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:56.560422 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dfd44fad-39d0-49cd-beb8-5295108d3dac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:56.560873 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dfd44fad-39d0-49cd-beb8-5295108d3dac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:56.561636 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dfd44fad-39d0-49cd-beb8-5295108d3dac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:56.562063 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dfd44fad-39d0-49cd-beb8-5295108d3dac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:56.691698 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-dfd44fad-39d0-49cd-beb8-5295108d3dac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:56.700035 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-dfd44fad-39d0-49cd-beb8-5295108d3dac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:56.701559 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-dfd44fad-39d0-49cd-beb8-5295108d3dac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:56.702706 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-dfd44fad-39d0-49cd-beb8-5295108d3dac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.153198 May 23 12:50:56.703267 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 248/503] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:56 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:50:56.707735 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-60bb1aab-a824-47e2-87e0-541ea52c7a9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:56.708705 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-60bb1aab-a824-47e2-87e0-541ea52c7a9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:56.715147 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-60bb1aab-a824-47e2-87e0-541ea52c7a9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:56.715853 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-60bb1aab-a824-47e2-87e0-541ea52c7a9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:56.716609 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-60bb1aab-a824-47e2-87e0-541ea52c7a9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:56.717042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-60bb1aab-a824-47e2-87e0-541ea52c7a9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:56.745493 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-60bb1aab-a824-47e2-87e0-541ea52c7a9c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 May 23 12:50:56.745967 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 249/504] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:50:56 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:50:57.371894 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-abd950dd-ef67-4268-8780-c7cbb215c44d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:57.372620 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-abd950dd-ef67-4268-8780-c7cbb215c44d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:57.379056 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-abd950dd-ef67-4268-8780-c7cbb215c44d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:57.379498 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-abd950dd-ef67-4268-8780-c7cbb215c44d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:57.380243 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-abd950dd-ef67-4268-8780-c7cbb215c44d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:57.380670 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-abd950dd-ef67-4268-8780-c7cbb215c44d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:57.525965 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-abd950dd-ef67-4268-8780-c7cbb215c44d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:57.544103 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-abd950dd-ef67-4268-8780-c7cbb215c44d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.175977 May 23 12:50:57.544842 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 250/505] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:57 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:50:57.549442 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6451d3d8-0cb5-4e0c-aa5a-2b9773828959 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:57.550243 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6451d3d8-0cb5-4e0c-aa5a-2b9773828959 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:57.556361 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6451d3d8-0cb5-4e0c-aa5a-2b9773828959 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:57.556809 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6451d3d8-0cb5-4e0c-aa5a-2b9773828959 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:57.557714 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6451d3d8-0cb5-4e0c-aa5a-2b9773828959 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:57.558143 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6451d3d8-0cb5-4e0c-aa5a-2b9773828959 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:57.734022 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f7e5e2ca-c811-4b85-b3bc-b6b70340015a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "POST /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.507785 May 23 12:50:57.735241 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 256/506] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:50:54 2022] POST /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments => generated 194 bytes in 3510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:50:57.769623 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-31c7d150-f3cc-46f6-ae84-4b48a29d33f9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:57.771133 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-31c7d150-f3cc-46f6-ae84-4b48a29d33f9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:57.783723 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-31c7d150-f3cc-46f6-ae84-4b48a29d33f9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:57.784554 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-31c7d150-f3cc-46f6-ae84-4b48a29d33f9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:57.785365 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-31c7d150-f3cc-46f6-ae84-4b48a29d33f9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:57.786670 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-31c7d150-f3cc-46f6-ae84-4b48a29d33f9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:57.857248 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6451d3d8-0cb5-4e0c-aa5a-2b9773828959 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:57.867553 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6451d3d8-0cb5-4e0c-aa5a-2b9773828959 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1513 microversion: 2.1 time: 0.321656 May 23 12:50:57.868280 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 251/507] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:57 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1513 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:57.877115 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0b206736-fea0-44be-8584-e7dc3f115c06 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:57.878406 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0b206736-fea0-44be-8584-e7dc3f115c06 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:57.888644 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0b206736-fea0-44be-8584-e7dc3f115c06 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:57.890667 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0b206736-fea0-44be-8584-e7dc3f115c06 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:57.892682 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0b206736-fea0-44be-8584-e7dc3f115c06 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:57.893362 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0b206736-fea0-44be-8584-e7dc3f115c06 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:57.937009 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0b206736-fea0-44be-8584-e7dc3f115c06 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067408 May 23 12:50:57.937816 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 252/508] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:50:57 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:50:57.984557 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-31c7d150-f3cc-46f6-ae84-4b48a29d33f9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:57.993834 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-31c7d150-f3cc-46f6-ae84-4b48a29d33f9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:57.995406 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-31c7d150-f3cc-46f6-ae84-4b48a29d33f9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:57.996834 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-31c7d150-f3cc-46f6-ae84-4b48a29d33f9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.259662 May 23 12:50:57.997584 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 257/509] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:57 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:58.005310 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b22e859d-7849-47da-90db-2ec4c99225a6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:58.005820 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b22e859d-7849-47da-90db-2ec4c99225a6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:58.012334 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b22e859d-7849-47da-90db-2ec4c99225a6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:58.013053 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b22e859d-7849-47da-90db-2ec4c99225a6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:58.013735 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b22e859d-7849-47da-90db-2ec4c99225a6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:58.014197 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b22e859d-7849-47da-90db-2ec4c99225a6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:58.043367 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b22e859d-7849-47da-90db-2ec4c99225a6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Going to try to terminate instance {{(pid=134547) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:50:58.136489 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b22e859d-7849-47da-90db-2ec4c99225a6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 204 len: 0 microversion: 2.1 time: 0.133885 May 23 12:50:58.138560 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 253/510] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:50:58 2022] DELETE /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 12:50:58.147320 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7d4ef875-99cd-4998-a016-cd77bfefb43b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:58.147942 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7d4ef875-99cd-4998-a016-cd77bfefb43b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:58.156046 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:50:58.158177 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7d4ef875-99cd-4998-a016-cd77bfefb43b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:58.158814 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7d4ef875-99cd-4998-a016-cd77bfefb43b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:58.160209 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7d4ef875-99cd-4998-a016-cd77bfefb43b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:58.160961 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7d4ef875-99cd-4998-a016-cd77bfefb43b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:58.313087 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-932d1c8e-6b9c-4491-b9d4-2d1f36c1e817 req-b6c50a84-eee2-44d5-a4f9-c8e68db583ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5c71c1d-673e-4a94-92c0-77b702758ea1", "name": "network-vif-deleted", "tag": "3956c5ac-1ad4-4d9f-9012-f95e99abc437"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:50:58.319598 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7d4ef875-99cd-4998-a016-cd77bfefb43b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:58.322238 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-932d1c8e-6b9c-4491-b9d4-2d1f36c1e817 req-b6c50a84-eee2-44d5-a4f9-c8e68db583ca service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:58.322687 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-932d1c8e-6b9c-4491-b9d4-2d1f36c1e817 req-b6c50a84-eee2-44d5-a4f9-c8e68db583ca service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:58.333261 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7d4ef875-99cd-4998-a016-cd77bfefb43b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1680 microversion: 2.1 time: 0.189402 May 23 12:50:58.336572 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-932d1c8e-6b9c-4491-b9d4-2d1f36c1e817 req-b6c50a84-eee2-44d5-a4f9-c8e68db583ca service nova] Creating event network-vif-deleted:3956c5ac-1ad4-4d9f-9012-f95e99abc437 for instance c5c71c1d-673e-4a94-92c0-77b702758ea1 on hv-cinder-maste May 23 12:50:58.337641 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 258/511] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:58 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:58.342100 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-932d1c8e-6b9c-4491-b9d4-2d1f36c1e817 req-b6c50a84-eee2-44d5-a4f9-c8e68db583ca service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033080 May 23 12:50:58.342954 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 254/512] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:50:58.561815 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-0542c722-e99e-49d7-a720-67357fcb295a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:58.562401 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-0542c722-e99e-49d7-a720-67357fcb295a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:58.568343 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0542c722-e99e-49d7-a720-67357fcb295a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:58.568779 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0542c722-e99e-49d7-a720-67357fcb295a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:58.569549 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0542c722-e99e-49d7-a720-67357fcb295a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:58.570002 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0542c722-e99e-49d7-a720-67357fcb295a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:58.696752 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-0542c722-e99e-49d7-a720-67357fcb295a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:58.704011 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-0542c722-e99e-49d7-a720-67357fcb295a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.146087 May 23 12:50:58.704575 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 259/513] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:58 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:58.894576 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a3c708d5-2067-4442-88c3-1f3d8a4f3e75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:58.895275 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a3c708d5-2067-4442-88c3-1f3d8a4f3e75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:58.902077 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a3c708d5-2067-4442-88c3-1f3d8a4f3e75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:58.902558 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a3c708d5-2067-4442-88c3-1f3d8a4f3e75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:58.903322 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a3c708d5-2067-4442-88c3-1f3d8a4f3e75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:58.903760 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a3c708d5-2067-4442-88c3-1f3d8a4f3e75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:58.969508 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a3c708d5-2067-4442-88c3-1f3d8a4f3e75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:58.977247 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a3c708d5-2067-4442-88c3-1f3d8a4f3e75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1471 microversion: 2.1 time: 0.087127 May 23 12:50:58.977815 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 255/514] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:58 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1471 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:59.015070 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4f41f61e-030b-4940-bd95-5fc1bc3f09cf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:59.015668 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4f41f61e-030b-4940-bd95-5fc1bc3f09cf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:59.021649 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4f41f61e-030b-4940-bd95-5fc1bc3f09cf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:59.022086 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4f41f61e-030b-4940-bd95-5fc1bc3f09cf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:59.022824 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4f41f61e-030b-4940-bd95-5fc1bc3f09cf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:59.023246 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4f41f61e-030b-4940-bd95-5fc1bc3f09cf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:59.154649 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4f41f61e-030b-4940-bd95-5fc1bc3f09cf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:59.162906 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4f41f61e-030b-4940-bd95-5fc1bc3f09cf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:59.164972 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4f41f61e-030b-4940-bd95-5fc1bc3f09cf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:59.166244 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4f41f61e-030b-4940-bd95-5fc1bc3f09cf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.155042 May 23 12:50:59.166803 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 260/515] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:50:59 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:50:59.350636 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e531a236-2f6d-49d4-b646-425db6c07bcc tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:59.351242 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e531a236-2f6d-49d4-b646-425db6c07bcc tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:59.358447 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e531a236-2f6d-49d4-b646-425db6c07bcc tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:59.358825 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e531a236-2f6d-49d4-b646-425db6c07bcc tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:59.359591 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e531a236-2f6d-49d4-b646-425db6c07bcc tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:59.360022 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e531a236-2f6d-49d4-b646-425db6c07bcc tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:59.489760 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e531a236-2f6d-49d4-b646-425db6c07bcc tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:59.497773 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e531a236-2f6d-49d4-b646-425db6c07bcc tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1680 microversion: 2.1 time: 0.150981 May 23 12:50:59.498350 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 256/516] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:59 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:59.721852 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-be57fd3d-65cf-464a-b97f-5c29040efa6d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:59.722488 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-be57fd3d-65cf-464a-b97f-5c29040efa6d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:50:59.729132 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-be57fd3d-65cf-464a-b97f-5c29040efa6d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:59.729605 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-be57fd3d-65cf-464a-b97f-5c29040efa6d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:59.730362 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-be57fd3d-65cf-464a-b97f-5c29040efa6d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:50:59.730794 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-be57fd3d-65cf-464a-b97f-5c29040efa6d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:50:59.860466 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-be57fd3d-65cf-464a-b97f-5c29040efa6d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:50:59.867799 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-be57fd3d-65cf-464a-b97f-5c29040efa6d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.149860 May 23 12:50:59.868359 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 261/517] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:59 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:50:59.995893 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-db815ee2-1cce-4300-b553-d52aab2757b2 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:50:59.996452 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-db815ee2-1cce-4300-b553-d52aab2757b2 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:00.003050 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-db815ee2-1cce-4300-b553-d52aab2757b2 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:00.003522 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-db815ee2-1cce-4300-b553-d52aab2757b2 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:00.004282 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-db815ee2-1cce-4300-b553-d52aab2757b2 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:00.004894 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-db815ee2-1cce-4300-b553-d52aab2757b2 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:00.066979 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-db815ee2-1cce-4300-b553-d52aab2757b2 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:00.075114 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-db815ee2-1cce-4300-b553-d52aab2757b2 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1303 microversion: 2.1 time: 0.084549 May 23 12:51:00.075682 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 257/518] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:50:59 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:00.183917 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-da93c044-8432-40ba-8907-8d27e68260fb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:00.184531 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-da93c044-8432-40ba-8907-8d27e68260fb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:00.190499 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-da93c044-8432-40ba-8907-8d27e68260fb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:00.190967 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-da93c044-8432-40ba-8907-8d27e68260fb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:00.191721 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-da93c044-8432-40ba-8907-8d27e68260fb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:00.192170 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-da93c044-8432-40ba-8907-8d27e68260fb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:00.323248 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-da93c044-8432-40ba-8907-8d27e68260fb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:00.331842 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-da93c044-8432-40ba-8907-8d27e68260fb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:00.333398 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-da93c044-8432-40ba-8907-8d27e68260fb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:00.334565 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-da93c044-8432-40ba-8907-8d27e68260fb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.155166 May 23 12:51:00.345952 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 262/519] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:00 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:51:00.514814 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-828d04b9-b2c3-47ad-be32-6165275fa193 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:00.515475 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-828d04b9-b2c3-47ad-be32-6165275fa193 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:00.521569 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-828d04b9-b2c3-47ad-be32-6165275fa193 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:00.522018 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-828d04b9-b2c3-47ad-be32-6165275fa193 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:00.522829 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-828d04b9-b2c3-47ad-be32-6165275fa193 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:00.523204 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-828d04b9-b2c3-47ad-be32-6165275fa193 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:00.651319 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-828d04b9-b2c3-47ad-be32-6165275fa193 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:00.658689 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-828d04b9-b2c3-47ad-be32-6165275fa193 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1680 microversion: 2.1 time: 0.147763 May 23 12:51:00.659249 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 258/520] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:00 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:00.885942 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-42b7ba92-3514-4948-bcd1-a3b43a086a94 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:00.886739 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-42b7ba92-3514-4948-bcd1-a3b43a086a94 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:00.901067 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-42b7ba92-3514-4948-bcd1-a3b43a086a94 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:00.901534 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-42b7ba92-3514-4948-bcd1-a3b43a086a94 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:00.903506 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-42b7ba92-3514-4948-bcd1-a3b43a086a94 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:00.903939 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-42b7ba92-3514-4948-bcd1-a3b43a086a94 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:01.064244 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-42b7ba92-3514-4948-bcd1-a3b43a086a94 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:01.074015 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-42b7ba92-3514-4948-bcd1-a3b43a086a94 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.193633 May 23 12:51:01.074603 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 263/521] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:00 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:01.093705 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:01.094315 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:01.102111 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:01.102826 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:01.103659 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:01.104866 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:01.126216 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:01.146118 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:01.146563 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:01.147007 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lazy-loading 'fault' on Instance uuid c5c71c1d-673e-4a94-92c0-77b702758ea1 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:51:01.217612 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:01.226911 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ddea15e4-1336-4d8f-bbd3-64685e34a968 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 200 len: 1308 microversion: 2.1 time: 0.137763 May 23 12:51:01.227745 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 259/522] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:01 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:01.355711 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-07f58fbe-d6b0-41ac-8d2d-28b4429de43d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:01.357073 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-07f58fbe-d6b0-41ac-8d2d-28b4429de43d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:01.363514 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-07f58fbe-d6b0-41ac-8d2d-28b4429de43d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:01.364985 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-07f58fbe-d6b0-41ac-8d2d-28b4429de43d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:01.366023 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-07f58fbe-d6b0-41ac-8d2d-28b4429de43d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:01.366667 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-07f58fbe-d6b0-41ac-8d2d-28b4429de43d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:01.520318 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-07f58fbe-d6b0-41ac-8d2d-28b4429de43d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:01.530218 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-07f58fbe-d6b0-41ac-8d2d-28b4429de43d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:01.531703 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-07f58fbe-d6b0-41ac-8d2d-28b4429de43d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:01.532842 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-07f58fbe-d6b0-41ac-8d2d-28b4429de43d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1809 microversion: 2.20 time: 0.183589 May 23 12:51:01.533673 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 264/523] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:01 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:51:01.676284 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ab045e9b-6697-4893-a409-af63094fd1c7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:01.676858 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ab045e9b-6697-4893-a409-af63094fd1c7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:01.683775 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ab045e9b-6697-4893-a409-af63094fd1c7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:01.684537 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ab045e9b-6697-4893-a409-af63094fd1c7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:01.685685 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ab045e9b-6697-4893-a409-af63094fd1c7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:01.686546 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ab045e9b-6697-4893-a409-af63094fd1c7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:01.856016 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-21798c26-9e01-4ebb-ae57-ed5dbc05e879 req-7b0269ab-e749-45c8-8468-9d25bd15fa20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6eb03bd-ab37-4dff-9646-6e6213c07618", "name": "network-vif-deleted", "tag": "6a3f6cae-6d76-40b6-9182-dbb64b47f665"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:01.878841 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-21798c26-9e01-4ebb-ae57-ed5dbc05e879 req-7b0269ab-e749-45c8-8468-9d25bd15fa20 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:01.880552 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-21798c26-9e01-4ebb-ae57-ed5dbc05e879 req-7b0269ab-e749-45c8-8468-9d25bd15fa20 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:01.882602 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ab045e9b-6697-4893-a409-af63094fd1c7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:01.892236 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ab045e9b-6697-4893-a409-af63094fd1c7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1613 microversion: 2.1 time: 0.219945 May 23 12:51:01.893305 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 260/524] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:01 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1613 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:01.906780 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-21798c26-9e01-4ebb-ae57-ed5dbc05e879 req-7b0269ab-e749-45c8-8468-9d25bd15fa20 service nova] Creating event network-vif-deleted:6a3f6cae-6d76-40b6-9182-dbb64b47f665 for instance d6eb03bd-ab37-4dff-9646-6e6213c07618 on hv-cinder-maste May 23 12:51:01.909356 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-21798c26-9e01-4ebb-ae57-ed5dbc05e879 req-7b0269ab-e749-45c8-8468-9d25bd15fa20 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058287 May 23 12:51:01.910544 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 265/525] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:02.091966 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-49c58712-0f4b-4897-ab25-c415e4f0de9e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:02.092737 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-49c58712-0f4b-4897-ab25-c415e4f0de9e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:02.096730 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:02.103182 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-49c58712-0f4b-4897-ab25-c415e4f0de9e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.103722 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-49c58712-0f4b-4897-ab25-c415e4f0de9e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.104880 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-49c58712-0f4b-4897-ab25-c415e4f0de9e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.105464 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-49c58712-0f4b-4897-ab25-c415e4f0de9e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.193024 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-af6f2071-fac1-493e-a399-e074b38196d8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:02.193785 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-af6f2071-fac1-493e-a399-e074b38196d8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:02.203004 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-af6f2071-fac1-493e-a399-e074b38196d8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.204013 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-af6f2071-fac1-493e-a399-e074b38196d8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.204827 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-af6f2071-fac1-493e-a399-e074b38196d8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.205509 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-af6f2071-fac1-493e-a399-e074b38196d8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.264382 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-49c58712-0f4b-4897-ab25-c415e4f0de9e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:02.271973 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-49c58712-0f4b-4897-ab25-c415e4f0de9e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.184301 May 23 12:51:02.272548 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 261/526] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:02 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:02.279327 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6142cf1c-2523-4e4e-aca4-ee151b199c67 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:02.280172 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6142cf1c-2523-4e4e-aca4-ee151b199c67 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: c5c71c1d-673e-4a94-92c0-77b702758ea1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:02.287820 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6142cf1c-2523-4e4e-aca4-ee151b199c67 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.288451 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6142cf1c-2523-4e4e-aca4-ee151b199c67 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.289926 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6142cf1c-2523-4e4e-aca4-ee151b199c67 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.290473 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6142cf1c-2523-4e4e-aca4-ee151b199c67 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.304529 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-6142cf1c-2523-4e4e-aca4-ee151b199c67 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] HTTP exception thrown: Instance c5c71c1d-673e-4a94-92c0-77b702758ea1 could not be found. May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6142cf1c-2523-4e4e-aca4-ee151b199c67 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Request method failure captured: May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 HTTP/1.1 May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4LTJkyGfnTKy2-6-mbxxT-p7qSUEwYjUeuTbQOIx-YjRFuJJzfbhvMqnpVlDQ9Sh-bR_hJmt-JG9W_mOdEz3h8z70OLAPOVcqfYb-MgT1h_m4PiRiUrEHuEmbZND3BklxDq1cRFUTrDrlzRaHH2Euo8CzEFXPbZaNXqWn-ZZh0rCfE May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 138b75f9014a4698b462d0c7483b9420 May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-VolumesSnapshotTestJSON-259890111 May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:51:02.306750 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/138b75f9014a4698b462d0c7483b9420"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/138b75f9014a4698b462d0c7483b9420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/138b75f9014a4698b462d0c7483b9420"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_138b75f9014a4698b462d0c7483b9420"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-VolumesSnapshotTestJSON-259890111 May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 138b75f9014a4698b462d0c7483b9420 May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-259890111 May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-VolumesSnapshotTestJSON-259890111-project May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: b4f6e3f8e0f2431888f20f91fb469c72 May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-VolumesSnapshotTestJSON-259890111-project May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance c5c71c1d-673e-4a94-92c0-77b702758ea1 could not be found. May 23 12:51:02.308064 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': 'c5c71c1d-673e-4a94-92c0-77b702758ea1'} May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5c71c1d-673e-4a94-92c0-77b702758ea1 could not be found. May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:51:02.308925 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5c71c1d-673e-4a94-92c0-77b702758ea1 could not be found. May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5c71c1d-673e-4a94-92c0-77b702758ea1 could not be found. May 23 12:51:02.310222 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:51:02.311276 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6142cf1c-2523-4e4e-aca4-ee151b199c67 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Returning 404 to user: Instance c5c71c1d-673e-4a94-92c0-77b702758ea1 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:51:02.311276 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6142cf1c-2523-4e4e-aca4-ee151b199c67 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1" status: 404 len: 111 microversion: 2.1 time: 0.033766 May 23 12:51:02.311276 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 262/527] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:02 2022] GET /compute/v2.1/servers/c5c71c1d-673e-4a94-92c0-77b702758ea1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:51:02.375504 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-af6f2071-fac1-493e-a399-e074b38196d8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:02.385412 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-af6f2071-fac1-493e-a399-e074b38196d8 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1594 microversion: 2.1 time: 0.196490 May 23 12:51:02.386271 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 266/528] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:02 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1594 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:02.552236 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-fd9b02c3-ae6e-4311-be5d-c2687f991df4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:02.552840 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-fd9b02c3-ae6e-4311-be5d-c2687f991df4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:02.560739 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fd9b02c3-ae6e-4311-be5d-c2687f991df4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.561196 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fd9b02c3-ae6e-4311-be5d-c2687f991df4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.561966 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fd9b02c3-ae6e-4311-be5d-c2687f991df4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.562396 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fd9b02c3-ae6e-4311-be5d-c2687f991df4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.800360 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-fd9b02c3-ae6e-4311-be5d-c2687f991df4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:02.812177 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-fd9b02c3-ae6e-4311-be5d-c2687f991df4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:02.814470 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-fd9b02c3-ae6e-4311-be5d-c2687f991df4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:02.816107 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-fd9b02c3-ae6e-4311-be5d-c2687f991df4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1796 microversion: 2.20 time: 0.268100 May 23 12:51:02.817176 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 263/529] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:02 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1796 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:51:02.914342 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:02.914946 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:02.921909 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.922653 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.923643 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.924142 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.959620 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:02.960079 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:02.960538 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lazy-loading 'fault' on Instance uuid d6eb03bd-ab37-4dff-9646-6e6213c07618 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:51:03.006221 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:03.017384 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f7e06c32-22ab-43aa-81da-eb16cb1c4f80 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 200 len: 1330 microversion: 2.1 time: 0.106872 May 23 12:51:03.018094 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 267/530] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:02 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:03.290126 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f3aac4af-fa74-4572-b591-2072edb2d488 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:03.290754 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f3aac4af-fa74-4572-b591-2072edb2d488 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:03.297601 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f3aac4af-fa74-4572-b591-2072edb2d488 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:03.298052 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f3aac4af-fa74-4572-b591-2072edb2d488 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:03.298995 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f3aac4af-fa74-4572-b591-2072edb2d488 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:03.299607 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f3aac4af-fa74-4572-b591-2072edb2d488 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:03.538133 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f3aac4af-fa74-4572-b591-2072edb2d488 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:03.547952 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f3aac4af-fa74-4572-b591-2072edb2d488 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.261988 May 23 12:51:03.549102 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 264/531] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:03 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:04.036003 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b13c6b8d-1d02-4591-b617-5a9d55845e46 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:04.036616 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b13c6b8d-1d02-4591-b617-5a9d55845e46 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:04.045169 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b13c6b8d-1d02-4591-b617-5a9d55845e46 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:04.045742 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b13c6b8d-1d02-4591-b617-5a9d55845e46 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:04.046550 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b13c6b8d-1d02-4591-b617-5a9d55845e46 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:04.046986 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b13c6b8d-1d02-4591-b617-5a9d55845e46 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:04.060829 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-b13c6b8d-1d02-4591-b617-5a9d55845e46 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b13c6b8d-1d02-4591-b617-5a9d55845e46 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 HTTP/1.1 May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:51:04.062544 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:51:04.064049 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'd6eb03bd-ab37-4dff-9646-6e6213c07618'} May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:51:04.064917 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:51:04.066480 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:51:04.068673 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b13c6b8d-1d02-4591-b617-5a9d55845e46 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:51:04.068673 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b13c6b8d-1d02-4591-b617-5a9d55845e46 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 404 len: 111 microversion: 2.1 time: 0.031944 May 23 12:51:04.068673 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 268/532] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:04 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:51:04.073355 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a7116aea-1478-4c17-90fe-a00c08e860ac tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '.version_select at 0x7f6a3755e0d0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:04.084199 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:04.093188 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a7116aea-1478-4c17-90fe-a00c08e860ac tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-291890632" status: 202 len: 0 microversion: 2.1 time: 0.024071 May 23 12:51:04.093762 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 265/533] 10.222.0.45 () {58 vars in 1217 bytes} [Mon May 23 12:51:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-291890632 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:51:04.342687 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-bd628e8e-2c64-4472-bcd2-6aa836d6c369 req-bcb06ae8-37d1-4cfd-9a1e-9b5f0b05eec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b00eae-ec09-4a1b-9987-9044598907c3", "tag": "840097c5-e401-4648-8ecb-639577acce99"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:04.351061 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-bd628e8e-2c64-4472-bcd2-6aa836d6c369 req-bcb06ae8-37d1-4cfd-9a1e-9b5f0b05eec5 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:04.352137 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-bd628e8e-2c64-4472-bcd2-6aa836d6c369 req-bcb06ae8-37d1-4cfd-9a1e-9b5f0b05eec5 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:04.363556 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-bd628e8e-2c64-4472-bcd2-6aa836d6c369 req-bcb06ae8-37d1-4cfd-9a1e-9b5f0b05eec5 service nova] Creating event network-changed:840097c5-e401-4648-8ecb-639577acce99 for instance f2b00eae-ec09-4a1b-9987-9044598907c3 on hv-cinder-maste May 23 12:51:04.370511 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-bd628e8e-2c64-4472-bcd2-6aa836d6c369 req-bcb06ae8-37d1-4cfd-9a1e-9b5f0b05eec5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031839 May 23 12:51:04.374343 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 269/534] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:04.566998 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d85e84f1-dade-40db-8b34-1c67e942f28b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:04.567724 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d85e84f1-dade-40db-8b34-1c67e942f28b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:04.584492 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d85e84f1-dade-40db-8b34-1c67e942f28b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:04.585097 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d85e84f1-dade-40db-8b34-1c67e942f28b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:04.586932 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d85e84f1-dade-40db-8b34-1c67e942f28b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:04.587814 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d85e84f1-dade-40db-8b34-1c67e942f28b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:04.942377 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-827d078e-5edb-4824-9a0a-64b97fe2e2ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: .version_select at 0x7f6a36d43160>, body: {"keypair": {"name": "tempest-keypair-105782505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdAFGYrAIOKczhVOqp4027Q9qX6j10opXe8NP8E6yvdKl0su7TyoZZOPukbPYd9DPIuqTY7kuzbcod+biPBsSeJ9IHvKbkLXPb7Ly5UBx0y5Nr7Y+zwt1Ajx1eOgfoWzw=="}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:04.958189 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-827d078e-5edb-4824-9a0a-64b97fe2e2ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:51:04.962977 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-827d078e-5edb-4824-9a0a-64b97fe2e2ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for user 2335faffe08d4c75ab85aa124819c513 and project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:51:05.000504 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-827d078e-5edb-4824-9a0a-64b97fe2e2ba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061695 May 23 12:51:05.018336 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 270/535] 10.222.0.45 () {60 vars in 1158 bytes} [Mon May 23 12:51:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:51:05.202357 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d85e84f1-dade-40db-8b34-1c67e942f28b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:05.214964 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d85e84f1-dade-40db-8b34-1c67e942f28b tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.652737 May 23 12:51:05.225757 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 266/536] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:04 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:06.114358 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-648b892e-cf7f-4831-b3c9-0cf6c4a9c184 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-608902090"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:06.115765 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-648b892e-cf7f-4831-b3c9-0cf6c4a9c184 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:06.125426 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-648b892e-cf7f-4831-b3c9-0cf6c4a9c184 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:06.125957 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-648b892e-cf7f-4831-b3c9-0cf6c4a9c184 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:06.126726 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-648b892e-cf7f-4831-b3c9-0cf6c4a9c184 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:06.127155 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-648b892e-cf7f-4831-b3c9-0cf6c4a9c184 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:06.131236 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:06.233337 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8c0431ab-c6fc-497c-8c73-859011f4a709 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:06.234450 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8c0431ab-c6fc-497c-8c73-859011f4a709 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:06.246412 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c0431ab-c6fc-497c-8c73-859011f4a709 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:06.247136 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c0431ab-c6fc-497c-8c73-859011f4a709 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:06.247868 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c0431ab-c6fc-497c-8c73-859011f4a709 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:06.248306 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c0431ab-c6fc-497c-8c73-859011f4a709 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:06.287826 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.network.security_group_api [None req-648b892e-cf7f-4831-b3c9-0cf6c4a9c184 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Adding security group ade96cce-6938-4bf8-82ae-6a75ae48cbf6 to port 840097c5-e401-4648-8ecb-639577acce99 May 23 12:51:06.471945 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8c0431ab-c6fc-497c-8c73-859011f4a709 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:06.480545 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8c0431ab-c6fc-497c-8c73-859011f4a709 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.250924 May 23 12:51:06.490500 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 267/537] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:06 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:06.490500 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1145069237", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "networks": [{"uuid": "2a3805bb-a52c-4ab6-9e3f-bf6b54400956"}]}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:06.551359 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] validate_networks() for [('2a3805bb-a52c-4ab6-9e3f-bf6b54400956', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:51:06.732110 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-648b892e-cf7f-4831-b3c9-0cf6c4a9c184 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "POST /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/action" status: 202 len: 0 microversion: 2.1 time: 0.621982 May 23 12:51:06.733721 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 271/538] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:51:06 2022] POST /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:51:06.741190 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5513bf36-c34b-4877-8fae-b6d95262dada tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:06.742729 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5513bf36-c34b-4877-8fae-b6d95262dada tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:06.757417 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5513bf36-c34b-4877-8fae-b6d95262dada tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:06.758129 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5513bf36-c34b-4877-8fae-b6d95262dada tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:06.759483 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5513bf36-c34b-4877-8fae-b6d95262dada tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:06.763517 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5513bf36-c34b-4877-8fae-b6d95262dada tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:07.000550 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5513bf36-c34b-4877-8fae-b6d95262dada tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:07.013178 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5513bf36-c34b-4877-8fae-b6d95262dada tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1758 microversion: 2.1 time: 0.275416 May 23 12:51:07.014537 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 272/539] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:06 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1758 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:07.020638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-dd394345-9d32-4d8f-9bea-e08631bc8e2f req-2ab2ef25-9516-4943-a690-36c89d51b91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b00eae-ec09-4a1b-9987-9044598907c3", "tag": "840097c5-e401-4648-8ecb-639577acce99"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:07.032508 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-dd394345-9d32-4d8f-9bea-e08631bc8e2f req-2ab2ef25-9516-4943-a690-36c89d51b91d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:07.033694 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-dd394345-9d32-4d8f-9bea-e08631bc8e2f req-2ab2ef25-9516-4943-a690-36c89d51b91d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:07.059570 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-dd394345-9d32-4d8f-9bea-e08631bc8e2f req-2ab2ef25-9516-4943-a690-36c89d51b91d service nova] Creating event network-changed:840097c5-e401-4648-8ecb-639577acce99 for instance f2b00eae-ec09-4a1b-9987-9044598907c3 on hv-cinder-maste May 23 12:51:07.066764 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-dd394345-9d32-4d8f-9bea-e08631bc8e2f req-2ab2ef25-9516-4943-a690-36c89d51b91d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050550 May 23 12:51:07.068169 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 273/540] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:07.076672 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-962c03db-97d4-478e-9f2c-6af8206d7d55 req-fc19332b-e578-416b-ae2d-66851bddde5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a42629-21e9-4985-9f40-50fcb8ac70a5", "name": "network-vif-plugged", "status": "completed", "tag": "60f89927-1069-4785-bbc6-46be1dcf99aa"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:07.087426 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-962c03db-97d4-478e-9f2c-6af8206d7d55 req-fc19332b-e578-416b-ae2d-66851bddde5f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:07.088185 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-962c03db-97d4-478e-9f2c-6af8206d7d55 req-fc19332b-e578-416b-ae2d-66851bddde5f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:07.102961 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-962c03db-97d4-478e-9f2c-6af8206d7d55 req-fc19332b-e578-416b-ae2d-66851bddde5f service nova] Creating event network-vif-plugged:60f89927-1069-4785-bbc6-46be1dcf99aa for instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 on hv-cinder-maste May 23 12:51:07.109264 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-962c03db-97d4-478e-9f2c-6af8206d7d55 req-fc19332b-e578-416b-ae2d-66851bddde5f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038409 May 23 12:51:07.110210 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 274/541] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:07.116957 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-322524965", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6101120e-4403-4c14-bcc5-167e49bfb907"}], "security_groups": [{"name": "tempest-securitygroup--696959161"}], "key_name": "tempest-keypair-105782505", "user_data": "}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:07.277466 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.network.neutron [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] validate_networks() for [('6101120e-4403-4c14-bcc5-167e49bfb907', None, None, None, None, None)] {{(pid=134546) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:51:07.337729 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:51:07.339049 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:51:07.339847 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:51:07.340730 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:51:07.341387 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:51:07.352039 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:07.352864 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:07.353913 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:07.354571 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:07.375731 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Getting quotas for project 138b75f9014a4698b462d0c7483b9420. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:51:07.380074 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Getting quotas for user b4f6e3f8e0f2431888f20f91fb469c72 and project 138b75f9014a4698b462d0c7483b9420. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:51:07.392603 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:51:07.395561 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:51:07.456008 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a4e7c4d9-677c-40d0-a5c0-4566ed7a1d41 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.973676 May 23 12:51:07.457793 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 268/542] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:51:07.469648 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-fd940947-4a1b-4724-9e46-098e13f9031d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:07.470999 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-fd940947-4a1b-4724-9e46-098e13f9031d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:07.561261 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-fd940947-4a1b-4724-9e46-098e13f9031d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:07.573116 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-fd940947-4a1b-4724-9e46-098e13f9031d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1219 microversion: 2.1 time: 0.108304 May 23 12:51:07.578841 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 269/543] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:07 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:07.585463 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-eeef1de2-3134-4ae7-a494-c09e80ac4644 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:07.587034 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-eeef1de2-3134-4ae7-a494-c09e80ac4644 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:07.596648 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eeef1de2-3134-4ae7-a494-c09e80ac4644 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:07.597396 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eeef1de2-3134-4ae7-a494-c09e80ac4644 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:07.598411 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eeef1de2-3134-4ae7-a494-c09e80ac4644 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:07.599147 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-eeef1de2-3134-4ae7-a494-c09e80ac4644 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:07.797726 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-eeef1de2-3134-4ae7-a494-c09e80ac4644 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:07.808788 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-eeef1de2-3134-4ae7-a494-c09e80ac4644 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.228871 May 23 12:51:07.809515 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 270/544] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:07 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:07.820934 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Flavor limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:51:07.821607 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Image limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:51:07.822291 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Flavor pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:51:07.822940 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Image pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:51:07.823496 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:51:07.834055 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:07.834735 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:07.836449 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:07.837869 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:07.862221 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:51:07.868299 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for user 2335faffe08d4c75ab85aa124819c513 and project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:51:07.879858 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Going to run 1 instances... {{(pid=134546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:51:07.883222 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:51:07.933808 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-50368d2b-dd22-44bc-83df-97b33f935bea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.822169 May 23 12:51:07.941950 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 275/545] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:51:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:51:07.948224 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5445dbd1-d346-4216-aa62-e87ce0983d7d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:07.949100 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5445dbd1-d346-4216-aa62-e87ce0983d7d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:08.014624 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5445dbd1-d346-4216-aa62-e87ce0983d7d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:08.021960 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5445dbd1-d346-4216-aa62-e87ce0983d7d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1240 microversion: 2.1 time: 0.078849 May 23 12:51:08.022544 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 271/546] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:07 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:08.591959 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a200beeb-8894-4450-8277-afc5ab8b850a tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:08.592478 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a200beeb-8894-4450-8277-afc5ab8b850a tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:08.598724 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a200beeb-8894-4450-8277-afc5ab8b850a tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:08.599191 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a200beeb-8894-4450-8277-afc5ab8b850a tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:08.599926 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a200beeb-8894-4450-8277-afc5ab8b850a tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:08.600354 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a200beeb-8894-4450-8277-afc5ab8b850a tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:08.666243 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a200beeb-8894-4450-8277-afc5ab8b850a tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:08.673643 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a200beeb-8894-4450-8277-afc5ab8b850a tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1271 microversion: 2.1 time: 0.086426 May 23 12:51:08.674205 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 276/547] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:08 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:08.826512 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5ac17dce-c377-4982-a098-678f9c3af80c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:08.827126 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5ac17dce-c377-4982-a098-678f9c3af80c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:08.836672 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ac17dce-c377-4982-a098-678f9c3af80c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:08.837646 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ac17dce-c377-4982-a098-678f9c3af80c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:08.838431 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ac17dce-c377-4982-a098-678f9c3af80c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:08.838872 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ac17dce-c377-4982-a098-678f9c3af80c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:08.976004 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5ac17dce-c377-4982-a098-678f9c3af80c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:08.984220 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5ac17dce-c377-4982-a098-678f9c3af80c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1370 microversion: 2.1 time: 0.162398 May 23 12:51:08.984783 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 272/548] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:08 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:09.040330 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-28384712-e61c-46e4-9b76-99ce4408592e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:09.040961 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-28384712-e61c-46e4-9b76-99ce4408592e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:09.047050 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-28384712-e61c-46e4-9b76-99ce4408592e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:09.047493 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-28384712-e61c-46e4-9b76-99ce4408592e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:09.048246 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-28384712-e61c-46e4-9b76-99ce4408592e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:09.048676 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-28384712-e61c-46e4-9b76-99ce4408592e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:09.110524 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-28384712-e61c-46e4-9b76-99ce4408592e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:09.117877 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-28384712-e61c-46e4-9b76-99ce4408592e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1292 microversion: 2.1 time: 0.082282 May 23 12:51:09.118441 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 277/549] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:09 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1292 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:09.691240 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-fd286f63-a088-4e34-80c1-04c98e355f71 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:09.691755 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-fd286f63-a088-4e34-80c1-04c98e355f71 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:09.699517 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fd286f63-a088-4e34-80c1-04c98e355f71 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:09.699747 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fd286f63-a088-4e34-80c1-04c98e355f71 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:09.700315 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fd286f63-a088-4e34-80c1-04c98e355f71 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:09.700816 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fd286f63-a088-4e34-80c1-04c98e355f71 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:09.783494 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-fd286f63-a088-4e34-80c1-04c98e355f71 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:09.792301 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-fd286f63-a088-4e34-80c1-04c98e355f71 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1289 microversion: 2.1 time: 0.105007 May 23 12:51:09.793199 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 273/550] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:09 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:51:10.002364 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8042d760-56f6-430c-b3dc-9b8f780b954d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:10.003270 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8042d760-56f6-430c-b3dc-9b8f780b954d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:10.010857 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8042d760-56f6-430c-b3dc-9b8f780b954d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:10.011309 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8042d760-56f6-430c-b3dc-9b8f780b954d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:10.012084 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8042d760-56f6-430c-b3dc-9b8f780b954d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:10.012536 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8042d760-56f6-430c-b3dc-9b8f780b954d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:10.135410 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-48afdd5b-b0cc-4981-9a91-5ddefc8bc0ec tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:10.136808 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-48afdd5b-b0cc-4981-9a91-5ddefc8bc0ec tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:10.144912 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-48afdd5b-b0cc-4981-9a91-5ddefc8bc0ec tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:10.145675 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-48afdd5b-b0cc-4981-9a91-5ddefc8bc0ec tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:10.146638 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-48afdd5b-b0cc-4981-9a91-5ddefc8bc0ec tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:10.147263 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-48afdd5b-b0cc-4981-9a91-5ddefc8bc0ec tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:10.227755 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-48afdd5b-b0cc-4981-9a91-5ddefc8bc0ec tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:10.232856 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8042d760-56f6-430c-b3dc-9b8f780b954d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:10.240984 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-48afdd5b-b0cc-4981-9a91-5ddefc8bc0ec tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1298 microversion: 2.1 time: 0.109481 May 23 12:51:10.242205 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8042d760-56f6-430c-b3dc-9b8f780b954d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1564 microversion: 2.1 time: 0.244189 May 23 12:51:10.242339 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 274/551] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:10 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:51:10.243087 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 278/552] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:09 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1564 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:10.258781 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-33fb7a63-98a0-470c-8599-8ae5272d8f5c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:10.259365 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-33fb7a63-98a0-470c-8599-8ae5272d8f5c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:10.265711 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-33fb7a63-98a0-470c-8599-8ae5272d8f5c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:10.266157 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-33fb7a63-98a0-470c-8599-8ae5272d8f5c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:10.266923 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-33fb7a63-98a0-470c-8599-8ae5272d8f5c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:10.267361 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-33fb7a63-98a0-470c-8599-8ae5272d8f5c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:10.385224 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-33fb7a63-98a0-470c-8599-8ae5272d8f5c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130686 May 23 12:51:10.385835 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 275/553] 10.222.0.45 () {58 vars in 1274 bytes} [Mon May 23 12:51:10 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:51:10.808761 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-15d70118-0a46-46c1-a952-ad64e9265d27 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:10.809651 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-15d70118-0a46-46c1-a952-ad64e9265d27 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:10.816638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-15d70118-0a46-46c1-a952-ad64e9265d27 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:10.817308 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-15d70118-0a46-46c1-a952-ad64e9265d27 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:10.818411 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-15d70118-0a46-46c1-a952-ad64e9265d27 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:10.819012 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-15d70118-0a46-46c1-a952-ad64e9265d27 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:11.019876 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-15d70118-0a46-46c1-a952-ad64e9265d27 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:11.030882 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-15d70118-0a46-46c1-a952-ad64e9265d27 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1319 microversion: 2.1 time: 0.226139 May 23 12:51:11.040811 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 279/554] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:10 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:11.261286 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7046cfe8-1b8c-4ac4-980d-8417437f94bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:11.262442 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7046cfe8-1b8c-4ac4-980d-8417437f94bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:11.269519 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7046cfe8-1b8c-4ac4-980d-8417437f94bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:11.270038 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7046cfe8-1b8c-4ac4-980d-8417437f94bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:11.270909 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7046cfe8-1b8c-4ac4-980d-8417437f94bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:11.271476 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7046cfe8-1b8c-4ac4-980d-8417437f94bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:11.422079 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-7d31a5af-ce8c-4c6c-9f9f-e7afc048fc6c req-9c1a513c-5183-4db2-9e22-dbf5ed62291d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9218894f-57e2-4c73-9114-84275fabe11e", "tag": "5a86750c-5ccd-4bf6-b618-15b9d956e2fd"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:11.444292 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-7d31a5af-ce8c-4c6c-9f9f-e7afc048fc6c req-9c1a513c-5183-4db2-9e22-dbf5ed62291d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:11.446462 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-7d31a5af-ce8c-4c6c-9f9f-e7afc048fc6c req-9c1a513c-5183-4db2-9e22-dbf5ed62291d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:11.473998 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-7d31a5af-ce8c-4c6c-9f9f-e7afc048fc6c req-9c1a513c-5183-4db2-9e22-dbf5ed62291d service nova] Creating event network-changed:5a86750c-5ccd-4bf6-b618-15b9d956e2fd for instance 9218894f-57e2-4c73-9114-84275fabe11e on hv-cinder-maste May 23 12:51:11.479927 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-7d31a5af-ce8c-4c6c-9f9f-e7afc048fc6c req-9c1a513c-5183-4db2-9e22-dbf5ed62291d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061764 May 23 12:51:11.480777 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 280/555] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:11.674721 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7046cfe8-1b8c-4ac4-980d-8417437f94bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:11.683996 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7046cfe8-1b8c-4ac4-980d-8417437f94bf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1365 microversion: 2.1 time: 0.428534 May 23 12:51:11.684581 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 276/556] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:11 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1365 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:12.049528 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-dc9a15b2-0c57-4891-b042-3df5d46f4380 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:12.050894 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-dc9a15b2-0c57-4891-b042-3df5d46f4380 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:12.064387 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dc9a15b2-0c57-4891-b042-3df5d46f4380 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:12.066800 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dc9a15b2-0c57-4891-b042-3df5d46f4380 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:12.069453 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dc9a15b2-0c57-4891-b042-3df5d46f4380 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:12.070034 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dc9a15b2-0c57-4891-b042-3df5d46f4380 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:12.220430 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-dc9a15b2-0c57-4891-b042-3df5d46f4380 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:12.230285 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-dc9a15b2-0c57-4891-b042-3df5d46f4380 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1319 microversion: 2.1 time: 0.185489 May 23 12:51:12.230659 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 281/557] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:12 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:12.245398 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-2ddad6c9-ef7f-48ce-b567-97f2d801842a req-f9819bad-8134-42b4-a5e0-bcbfa6b71349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3479c365-b079-47fd-892d-fa850e6d6951", "tag": "d2463af3-71a7-41a4-b129-6fb247e9e617"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:12.253357 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-2ddad6c9-ef7f-48ce-b567-97f2d801842a req-f9819bad-8134-42b4-a5e0-bcbfa6b71349 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:12.253795 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-2ddad6c9-ef7f-48ce-b567-97f2d801842a req-f9819bad-8134-42b4-a5e0-bcbfa6b71349 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:12.264449 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-2ddad6c9-ef7f-48ce-b567-97f2d801842a req-f9819bad-8134-42b4-a5e0-bcbfa6b71349 service nova] Creating event network-changed:d2463af3-71a7-41a4-b129-6fb247e9e617 for instance 3479c365-b079-47fd-892d-fa850e6d6951 on hv-cinder-maste May 23 12:51:12.268998 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-2ddad6c9-ef7f-48ce-b567-97f2d801842a req-f9819bad-8134-42b4-a5e0-bcbfa6b71349 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027728 May 23 12:51:12.269627 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 277/558] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:12.700840 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9889fe1c-9e55-40f9-ba63-faf8de7550d0 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:12.701464 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-9889fe1c-9e55-40f9-ba63-faf8de7550d0 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:12.707342 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9889fe1c-9e55-40f9-ba63-faf8de7550d0 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:12.707784 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9889fe1c-9e55-40f9-ba63-faf8de7550d0 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:12.708545 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9889fe1c-9e55-40f9-ba63-faf8de7550d0 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:12.708977 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9889fe1c-9e55-40f9-ba63-faf8de7550d0 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:12.850779 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9889fe1c-9e55-40f9-ba63-faf8de7550d0 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:12.859000 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-9889fe1c-9e55-40f9-ba63-faf8de7550d0 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1365 microversion: 2.1 time: 0.162048 May 23 12:51:12.859579 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 282/559] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:12 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:51:13.249163 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-55c86787-7451-44d7-a048-96151907eb05 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:13.250633 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-55c86787-7451-44d7-a048-96151907eb05 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:13.258637 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-55c86787-7451-44d7-a048-96151907eb05 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:13.259405 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-55c86787-7451-44d7-a048-96151907eb05 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:13.260368 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-55c86787-7451-44d7-a048-96151907eb05 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:13.260943 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-55c86787-7451-44d7-a048-96151907eb05 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:13.521356 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-55c86787-7451-44d7-a048-96151907eb05 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:13.535475 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-55c86787-7451-44d7-a048-96151907eb05 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1319 microversion: 2.1 time: 0.291614 May 23 12:51:13.536169 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 278/560] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:13 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:13.876003 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-64c55156-d1fb-4d95-bb07-2957448304f9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:13.876747 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-64c55156-d1fb-4d95-bb07-2957448304f9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:13.883871 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-64c55156-d1fb-4d95-bb07-2957448304f9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:13.884319 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-64c55156-d1fb-4d95-bb07-2957448304f9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:13.885081 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-64c55156-d1fb-4d95-bb07-2957448304f9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:13.885547 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-64c55156-d1fb-4d95-bb07-2957448304f9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:14.016719 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-64c55156-d1fb-4d95-bb07-2957448304f9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:14.024922 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-64c55156-d1fb-4d95-bb07-2957448304f9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1365 microversion: 2.1 time: 0.152891 May 23 12:51:14.025519 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 283/561] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:13 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:14.293160 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-106a1deb-3590-4989-bc48-2edd65718938 req-4dd7392a-fc08-4c5c-a7a2-14f130f5fa4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a42629-21e9-4985-9f40-50fcb8ac70a5", "tag": "60f89927-1069-4785-bbc6-46be1dcf99aa"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:14.301530 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-106a1deb-3590-4989-bc48-2edd65718938 req-4dd7392a-fc08-4c5c-a7a2-14f130f5fa4c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:14.301963 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-106a1deb-3590-4989-bc48-2edd65718938 req-4dd7392a-fc08-4c5c-a7a2-14f130f5fa4c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:14.313092 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-106a1deb-3590-4989-bc48-2edd65718938 req-4dd7392a-fc08-4c5c-a7a2-14f130f5fa4c service nova] Creating event network-changed:60f89927-1069-4785-bbc6-46be1dcf99aa for instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 on hv-cinder-maste May 23 12:51:14.317672 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-106a1deb-3590-4989-bc48-2edd65718938 req-4dd7392a-fc08-4c5c-a7a2-14f130f5fa4c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028270 May 23 12:51:14.318218 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 279/562] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:14.553606 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f7cc0f15-07c8-4a9b-98d2-e6b0d4dcea54 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:14.554720 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f7cc0f15-07c8-4a9b-98d2-e6b0d4dcea54 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:14.560750 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7cc0f15-07c8-4a9b-98d2-e6b0d4dcea54 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:14.561214 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7cc0f15-07c8-4a9b-98d2-e6b0d4dcea54 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:14.561966 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7cc0f15-07c8-4a9b-98d2-e6b0d4dcea54 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:14.562392 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f7cc0f15-07c8-4a9b-98d2-e6b0d4dcea54 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:14.698377 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f7cc0f15-07c8-4a9b-98d2-e6b0d4dcea54 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:14.705719 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f7cc0f15-07c8-4a9b-98d2-e6b0d4dcea54 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1319 microversion: 2.1 time: 0.156008 May 23 12:51:14.706382 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 284/563] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:14 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:15.043853 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e75120ca-d2e4-4f33-ba89-731799b30579 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:15.044562 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e75120ca-d2e4-4f33-ba89-731799b30579 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:15.050720 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e75120ca-d2e4-4f33-ba89-731799b30579 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:15.051182 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e75120ca-d2e4-4f33-ba89-731799b30579 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:15.051949 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e75120ca-d2e4-4f33-ba89-731799b30579 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:15.052388 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e75120ca-d2e4-4f33-ba89-731799b30579 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:15.198405 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e75120ca-d2e4-4f33-ba89-731799b30579 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:15.206939 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e75120ca-d2e4-4f33-ba89-731799b30579 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1365 microversion: 2.1 time: 0.167697 May 23 12:51:15.207514 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 280/564] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:15 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:15.722680 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-cb6074bb-9193-4f35-aa5b-4af5af545b00 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:15.723284 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-cb6074bb-9193-4f35-aa5b-4af5af545b00 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:15.729932 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cb6074bb-9193-4f35-aa5b-4af5af545b00 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:15.730368 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cb6074bb-9193-4f35-aa5b-4af5af545b00 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:15.731114 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cb6074bb-9193-4f35-aa5b-4af5af545b00 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:15.731537 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cb6074bb-9193-4f35-aa5b-4af5af545b00 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:15.859227 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-cb6074bb-9193-4f35-aa5b-4af5af545b00 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:15.866430 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-cb6074bb-9193-4f35-aa5b-4af5af545b00 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1319 microversion: 2.1 time: 0.147602 May 23 12:51:15.867770 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 285/565] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:15 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:16.225062 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f89093f6-c961-408c-962f-0ad1f9a91a8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:16.225715 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f89093f6-c961-408c-962f-0ad1f9a91a8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:16.232667 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f89093f6-c961-408c-962f-0ad1f9a91a8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:16.233153 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f89093f6-c961-408c-962f-0ad1f9a91a8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:16.233907 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f89093f6-c961-408c-962f-0ad1f9a91a8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:16.234336 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f89093f6-c961-408c-962f-0ad1f9a91a8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:16.361394 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f89093f6-c961-408c-962f-0ad1f9a91a8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:16.364843 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=100 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:16.370487 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f89093f6-c961-408c-962f-0ad1f9a91a8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1365 microversion: 2.1 time: 0.149481 May 23 12:51:16.371164 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 281/566] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:16 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:16.884542 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-304accd1-1fe0-4f95-81a7-5f2d84ba3997 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:16.885304 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-304accd1-1fe0-4f95-81a7-5f2d84ba3997 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:16.891687 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-304accd1-1fe0-4f95-81a7-5f2d84ba3997 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:16.892130 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-304accd1-1fe0-4f95-81a7-5f2d84ba3997 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:16.892889 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-304accd1-1fe0-4f95-81a7-5f2d84ba3997 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:16.893352 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-304accd1-1fe0-4f95-81a7-5f2d84ba3997 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:16.989025 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-b28a7aa4-bd42-4f5e-9778-8b7f7019de0f req-a92b3c7a-7630-4a22-aa0f-db43fa6b98db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9218894f-57e2-4c73-9114-84275fabe11e", "name": "network-vif-plugged", "status": "completed", "tag": "5a86750c-5ccd-4bf6-b618-15b9d956e2fd"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:17.017377 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-b28a7aa4-bd42-4f5e-9778-8b7f7019de0f req-a92b3c7a-7630-4a22-aa0f-db43fa6b98db service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:17.017887 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-b28a7aa4-bd42-4f5e-9778-8b7f7019de0f req-a92b3c7a-7630-4a22-aa0f-db43fa6b98db service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:17.035806 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-b28a7aa4-bd42-4f5e-9778-8b7f7019de0f req-a92b3c7a-7630-4a22-aa0f-db43fa6b98db service nova] Creating event network-vif-plugged:5a86750c-5ccd-4bf6-b618-15b9d956e2fd for instance 9218894f-57e2-4c73-9114-84275fabe11e on hv-cinder-maste May 23 12:51:17.038404 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-304accd1-1fe0-4f95-81a7-5f2d84ba3997 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:17.040920 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-b28a7aa4-bd42-4f5e-9778-8b7f7019de0f req-a92b3c7a-7630-4a22-aa0f-db43fa6b98db service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055816 May 23 12:51:17.042376 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 282/567] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:17.046292 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-304accd1-1fe0-4f95-81a7-5f2d84ba3997 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1319 microversion: 2.1 time: 0.166287 May 23 12:51:17.046997 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 286/568] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:16 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:17.384703 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:17.389483 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c5a52bb6-3967-4779-9a14-91917557bdb3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:17.390175 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c5a52bb6-3967-4779-9a14-91917557bdb3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:17.396905 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c5a52bb6-3967-4779-9a14-91917557bdb3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:17.397604 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c5a52bb6-3967-4779-9a14-91917557bdb3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:17.399016 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c5a52bb6-3967-4779-9a14-91917557bdb3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:17.399453 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c5a52bb6-3967-4779-9a14-91917557bdb3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:17.531304 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c5a52bb6-3967-4779-9a14-91917557bdb3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:17.539384 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c5a52bb6-3967-4779-9a14-91917557bdb3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1365 microversion: 2.1 time: 0.155474 May 23 12:51:17.539946 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 283/569] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:17 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:18.063470 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c63f9f61-2206-4c77-b978-67595d5c9703 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:18.064174 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c63f9f61-2206-4c77-b978-67595d5c9703 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:18.072016 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=2 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:18.072712 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=10 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:18.080112 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c63f9f61-2206-4c77-b978-67595d5c9703 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:18.080562 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c63f9f61-2206-4c77-b978-67595d5c9703 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:18.081368 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c63f9f61-2206-4c77-b978-67595d5c9703 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:18.081797 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c63f9f61-2206-4c77-b978-67595d5c9703 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:18.210333 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c63f9f61-2206-4c77-b978-67595d5c9703 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:18.217919 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c63f9f61-2206-4c77-b978-67595d5c9703 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1319 microversion: 2.1 time: 0.158410 May 23 12:51:18.218484 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 287/570] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:18 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:18.556675 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a631a7d2-1d63-43c8-8189-d310baf6883b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:18.557306 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a631a7d2-1d63-43c8-8189-d310baf6883b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:18.559161 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=10 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:18.565118 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a631a7d2-1d63-43c8-8189-d310baf6883b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:18.565910 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a631a7d2-1d63-43c8-8189-d310baf6883b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:18.566669 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a631a7d2-1d63-43c8-8189-d310baf6883b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:18.567101 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a631a7d2-1d63-43c8-8189-d310baf6883b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:18.699269 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a631a7d2-1d63-43c8-8189-d310baf6883b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:18.706752 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a631a7d2-1d63-43c8-8189-d310baf6883b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1365 microversion: 2.1 time: 0.154647 May 23 12:51:18.707289 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 284/571] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:18 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:19.057992 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-1f3565a4-cbf1-456f-94d8-09300cab3fb9 req-cac651b8-1016-4fe1-aee3-0e284519c0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3479c365-b079-47fd-892d-fa850e6d6951", "name": "network-vif-plugged", "status": "completed", "tag": "d2463af3-71a7-41a4-b129-6fb247e9e617"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:19.066236 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-1f3565a4-cbf1-456f-94d8-09300cab3fb9 req-cac651b8-1016-4fe1-aee3-0e284519c0e9 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:19.066964 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-1f3565a4-cbf1-456f-94d8-09300cab3fb9 req-cac651b8-1016-4fe1-aee3-0e284519c0e9 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:19.078973 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-1f3565a4-cbf1-456f-94d8-09300cab3fb9 req-cac651b8-1016-4fe1-aee3-0e284519c0e9 service nova] Creating event network-vif-plugged:d2463af3-71a7-41a4-b129-6fb247e9e617 for instance 3479c365-b079-47fd-892d-fa850e6d6951 on hv-cinder-maste May 23 12:51:19.085202 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-1f3565a4-cbf1-456f-94d8-09300cab3fb9 req-cac651b8-1016-4fe1-aee3-0e284519c0e9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030440 May 23 12:51:19.086294 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 288/572] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:19.234968 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1fbdf24f-5951-43b9-9916-f498b4fcd569 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:19.235569 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1fbdf24f-5951-43b9-9916-f498b4fcd569 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:19.241590 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1fbdf24f-5951-43b9-9916-f498b4fcd569 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:19.242235 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1fbdf24f-5951-43b9-9916-f498b4fcd569 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:19.243901 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1fbdf24f-5951-43b9-9916-f498b4fcd569 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:19.244334 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1fbdf24f-5951-43b9-9916-f498b4fcd569 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:19.376662 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-1fbdf24f-5951-43b9-9916-f498b4fcd569 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:19.384418 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1fbdf24f-5951-43b9-9916-f498b4fcd569 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1319 microversion: 2.1 time: 0.153302 May 23 12:51:19.385009 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 285/573] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:19 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:19.724422 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c0d67707-ce4d-49ec-805a-f43ad0d2974d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:19.725103 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c0d67707-ce4d-49ec-805a-f43ad0d2974d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:19.731992 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c0d67707-ce4d-49ec-805a-f43ad0d2974d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:19.732437 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c0d67707-ce4d-49ec-805a-f43ad0d2974d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:19.733207 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c0d67707-ce4d-49ec-805a-f43ad0d2974d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:19.733636 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c0d67707-ce4d-49ec-805a-f43ad0d2974d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:19.861117 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c0d67707-ce4d-49ec-805a-f43ad0d2974d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:19.868741 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c0d67707-ce4d-49ec-805a-f43ad0d2974d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1556 microversion: 2.1 time: 0.148538 May 23 12:51:19.869333 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 289/574] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:19 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:19.885270 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-75566877-8b4d-45ee-a0b6-6c84bd0c6017 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:19.885753 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-75566877-8b4d-45ee-a0b6-6c84bd0c6017 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:19.892126 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-75566877-8b4d-45ee-a0b6-6c84bd0c6017 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:19.892553 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-75566877-8b4d-45ee-a0b6-6c84bd0c6017 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:19.893329 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-75566877-8b4d-45ee-a0b6-6c84bd0c6017 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:19.893760 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-75566877-8b4d-45ee-a0b6-6c84bd0c6017 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:19.970227 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-75566877-8b4d-45ee-a0b6-6c84bd0c6017 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089239 May 23 12:51:19.970822 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 286/575] 10.222.0.45 () {58 vars in 1274 bytes} [Mon May 23 12:51:19 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:20.401739 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6a0b9e89-adba-4ed1-a6b4-0ddb189f7ea4 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:20.402343 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6a0b9e89-adba-4ed1-a6b4-0ddb189f7ea4 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:20.408781 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6a0b9e89-adba-4ed1-a6b4-0ddb189f7ea4 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:20.409314 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6a0b9e89-adba-4ed1-a6b4-0ddb189f7ea4 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:20.410106 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6a0b9e89-adba-4ed1-a6b4-0ddb189f7ea4 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:20.410539 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6a0b9e89-adba-4ed1-a6b4-0ddb189f7ea4 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:20.550226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6a0b9e89-adba-4ed1-a6b4-0ddb189f7ea4 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:20.557830 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6a0b9e89-adba-4ed1-a6b4-0ddb189f7ea4 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1319 microversion: 2.1 time: 0.160576 May 23 12:51:20.558416 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 290/576] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:20 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:21.124690 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-38ef0d3f-1232-4d5a-aeb2-d8a51d952edc req-b826efad-9956-4cc1-8fff-aa2b6403a39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9218894f-57e2-4c73-9114-84275fabe11e", "tag": "5a86750c-5ccd-4bf6-b618-15b9d956e2fd"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:21.134347 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-38ef0d3f-1232-4d5a-aeb2-d8a51d952edc req-b826efad-9956-4cc1-8fff-aa2b6403a39b service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:21.135056 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-38ef0d3f-1232-4d5a-aeb2-d8a51d952edc req-b826efad-9956-4cc1-8fff-aa2b6403a39b service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:21.149941 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-38ef0d3f-1232-4d5a-aeb2-d8a51d952edc req-b826efad-9956-4cc1-8fff-aa2b6403a39b service nova] Creating event network-changed:5a86750c-5ccd-4bf6-b618-15b9d956e2fd for instance 9218894f-57e2-4c73-9114-84275fabe11e on hv-cinder-maste May 23 12:51:21.155363 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-38ef0d3f-1232-4d5a-aeb2-d8a51d952edc req-b826efad-9956-4cc1-8fff-aa2b6403a39b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037018 May 23 12:51:21.156038 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 287/577] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:21.575671 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-722c7b16-b974-42aa-a47c-bcc7ce945834 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:21.576449 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-722c7b16-b974-42aa-a47c-bcc7ce945834 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:21.582856 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-722c7b16-b974-42aa-a47c-bcc7ce945834 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:21.583378 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-722c7b16-b974-42aa-a47c-bcc7ce945834 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:21.584201 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-722c7b16-b974-42aa-a47c-bcc7ce945834 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:21.584799 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-722c7b16-b974-42aa-a47c-bcc7ce945834 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:21.604354 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=100 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:21.778707 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-722c7b16-b974-42aa-a47c-bcc7ce945834 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:21.786612 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-722c7b16-b974-42aa-a47c-bcc7ce945834 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1509 microversion: 2.1 time: 0.215622 May 23 12:51:21.787182 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 291/578] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:21 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:21.804688 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9946f02f-0909-4636-bd1e-c61b93158c75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3184149-3bac-4c99-8d2b-fb05d39a3638", "device": "/dev/sdb"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:21.806643 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9946f02f-0909-4636-bd1e-c61b93158c75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:21.812954 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9946f02f-0909-4636-bd1e-c61b93158c75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:21.813617 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9946f02f-0909-4636-bd1e-c61b93158c75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:21.814364 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9946f02f-0909-4636-bd1e-c61b93158c75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:21.814790 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9946f02f-0909-4636-bd1e-c61b93158c75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:22.083168 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9946f02f-0909-4636-bd1e-c61b93158c75 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "POST /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282813 May 23 12:51:22.083699 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 288/579] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:51:21 2022] POST /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:24.615858 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-14112ff0-a0d2-4520-85d4-d4fd19f5455b req-4e3a3974-1ba7-4ed1-bbd4-2a63d4a6eedc admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "d3184149-3bac-4c99-8d2b-fb05d39a3638", "create_info": {"type": "qcow2", "new_file": "volume-d3184149-3bac-4c99-8d2b-fb05d39a3638.25aeb8df-f536-4b11-8bd5-7f68bdf4b58e.vhdx", "snapshot_id": "25aeb8df-f536-4b11-8bd5-7f68bdf4b58e"}}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:24.618738 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-14112ff0-a0d2-4520-85d4-d4fd19f5455b req-4e3a3974-1ba7-4ed1-bbd4-2a63d4a6eedc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:24.619194 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-14112ff0-a0d2-4520-85d4-d4fd19f5455b req-4e3a3974-1ba7-4ed1-bbd4-2a63d4a6eedc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:24.627125 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-14112ff0-a0d2-4520-85d4-d4fd19f5455b req-4e3a3974-1ba7-4ed1-bbd4-2a63d4a6eedc admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:24.627585 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-14112ff0-a0d2-4520-85d4-d4fd19f5455b req-4e3a3974-1ba7-4ed1-bbd4-2a63d4a6eedc admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:24.640976 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-14112ff0-a0d2-4520-85d4-d4fd19f5455b req-4e3a3974-1ba7-4ed1-bbd4-2a63d4a6eedc admin admin] 10.222.0.55 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.077387 May 23 12:51:24.641656 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 292/580] 10.222.0.55 () {64 vars in 1326 bytes} [Mon May 23 12:51:24 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:51:27.955922 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-50b77e82-7eb0-4663-a108-2e259d8996be req-a5e5e718-0db3-4e04-ab76-161aca01a5c6 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "d3184149-3bac-4c99-8d2b-fb05d39a3638", "create_info": {"type": "qcow2", "new_file": "volume-d3184149-3bac-4c99-8d2b-fb05d39a3638.6109394d-13c8-43c2-932b-d0fabdbda52a.vhdx", "snapshot_id": "6109394d-13c8-43c2-932b-d0fabdbda52a"}}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:27.957958 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-50b77e82-7eb0-4663-a108-2e259d8996be req-a5e5e718-0db3-4e04-ab76-161aca01a5c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:27.958414 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-50b77e82-7eb0-4663-a108-2e259d8996be req-a5e5e718-0db3-4e04-ab76-161aca01a5c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:27.967319 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-50b77e82-7eb0-4663-a108-2e259d8996be req-a5e5e718-0db3-4e04-ab76-161aca01a5c6 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:27.967754 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-50b77e82-7eb0-4663-a108-2e259d8996be req-a5e5e718-0db3-4e04-ab76-161aca01a5c6 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:27.981125 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-50b77e82-7eb0-4663-a108-2e259d8996be req-a5e5e718-0db3-4e04-ab76-161aca01a5c6 admin admin] 10.222.0.55 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.081124 May 23 12:51:27.981724 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 289/581] 10.222.0.55 () {64 vars in 1326 bytes} [Mon May 23 12:51:27 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:51:30.972898 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-ef9fd91e-1734-465d-a98a-849b9ae54ddc req-faed76af-a967-4cf7-b813-d0d64dadea55 admin admin] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:30.975001 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-ef9fd91e-1734-465d-a98a-849b9ae54ddc req-faed76af-a967-4cf7-b813-d0d64dadea55 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:30.975444 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-ef9fd91e-1734-465d-a98a-849b9ae54ddc req-faed76af-a967-4cf7-b813-d0d64dadea55 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:30.984512 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-ef9fd91e-1734-465d-a98a-849b9ae54ddc req-faed76af-a967-4cf7-b813-d0d64dadea55 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:30.984889 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-ef9fd91e-1734-465d-a98a-849b9ae54ddc req-faed76af-a967-4cf7-b813-d0d64dadea55 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:30.997489 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-ef9fd91e-1734-465d-a98a-849b9ae54ddc req-faed76af-a967-4cf7-b813-d0d64dadea55 admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/6109394d-13c8-43c2-932b-d0fabdbda52a?delete_info=%7B%22file_to_merge%22:%20%22volume-d3184149-3bac-4c99-8d2b-fb05d39a3638.6109394d-13c8-43c2-932b-d0fabdbda52a.vhdx%22,%20%22volume_id%22:%20%22d3184149-3bac-4c99-8d2b-fb05d39a3638%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.074194 May 23 12:51:30.998065 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 293/582] 10.222.0.55 () {62 vars in 1800 bytes} [Mon May 23 12:51:30 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/6109394d-13c8-43c2-932b-d0fabdbda52a?delete_info=%7B%22file_to_merge%22:%20%22volume-d3184149-3bac-4c99-8d2b-fb05d39a3638.6109394d-13c8-43c2-932b-d0fabdbda52a.vhdx%22,%20%22volume_id%22:%20%22d3184149-3bac-4c99-8d2b-fb05d39a3638%22%7D => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:51:34.035155 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:34.085657 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-14a00df5-17e7-4b05-8ef3-a9f0fa57715e req-9ae44728-dcac-422f-85ca-6a5547e5b893 admin admin] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:34.088261 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-14a00df5-17e7-4b05-8ef3-a9f0fa57715e req-9ae44728-dcac-422f-85ca-6a5547e5b893 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:34.088730 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-14a00df5-17e7-4b05-8ef3-a9f0fa57715e req-9ae44728-dcac-422f-85ca-6a5547e5b893 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:34.098157 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-14a00df5-17e7-4b05-8ef3-a9f0fa57715e req-9ae44728-dcac-422f-85ca-6a5547e5b893 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:34.098600 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-14a00df5-17e7-4b05-8ef3-a9f0fa57715e req-9ae44728-dcac-422f-85ca-6a5547e5b893 admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:34.111809 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-14a00df5-17e7-4b05-8ef3-a9f0fa57715e req-9ae44728-dcac-422f-85ca-6a5547e5b893 admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/ab7c3c8f-805b-4937-ab27-e05c05968a03?delete_info=%7B%22file_to_merge%22:%20%22volume-d3184149-3bac-4c99-8d2b-fb05d39a3638.ab7c3c8f-805b-4937-ab27-e05c05968a03.vhdx%22,%20%22volume_id%22:%20%22d3184149-3bac-4c99-8d2b-fb05d39a3638%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.077898 May 23 12:51:34.112385 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 290/583] 10.222.0.55 () {62 vars in 1800 bytes} [Mon May 23 12:51:34 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/ab7c3c8f-805b-4937-ab27-e05c05968a03?delete_info=%7B%22file_to_merge%22:%20%22volume-d3184149-3bac-4c99-8d2b-fb05d39a3638.ab7c3c8f-805b-4937-ab27-e05c05968a03.vhdx%22,%20%22volume_id%22:%20%22d3184149-3bac-4c99-8d2b-fb05d39a3638%22%7D => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:51:37.205090 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:37.255624 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-f7a7236e-20ea-49ab-bb56-69dc2ac1d8b8 req-5969c08d-ad74-4b44-abc9-5b7f7b5acf7b admin admin] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:37.257677 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-f7a7236e-20ea-49ab-bb56-69dc2ac1d8b8 req-5969c08d-ad74-4b44-abc9-5b7f7b5acf7b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:37.258119 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-f7a7236e-20ea-49ab-bb56-69dc2ac1d8b8 req-5969c08d-ad74-4b44-abc9-5b7f7b5acf7b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:37.267241 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-f7a7236e-20ea-49ab-bb56-69dc2ac1d8b8 req-5969c08d-ad74-4b44-abc9-5b7f7b5acf7b admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:37.267682 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-f7a7236e-20ea-49ab-bb56-69dc2ac1d8b8 req-5969c08d-ad74-4b44-abc9-5b7f7b5acf7b admin admin] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:37.280436 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-f7a7236e-20ea-49ab-bb56-69dc2ac1d8b8 req-5969c08d-ad74-4b44-abc9-5b7f7b5acf7b admin admin] 10.222.0.55 "DELETE /compute/v2.1/os-assisted-volume-snapshots/25aeb8df-f536-4b11-8bd5-7f68bdf4b58e?delete_info=%7B%22file_to_merge%22:%20%22volume-d3184149-3bac-4c99-8d2b-fb05d39a3638.25aeb8df-f536-4b11-8bd5-7f68bdf4b58e.vhdx%22,%20%22volume_id%22:%20%22d3184149-3bac-4c99-8d2b-fb05d39a3638%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.075997 May 23 12:51:37.281000 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 294/584] 10.222.0.55 () {62 vars in 1800 bytes} [Mon May 23 12:51:37 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/25aeb8df-f536-4b11-8bd5-7f68bdf4b58e?delete_info=%7B%22file_to_merge%22:%20%22volume-d3184149-3bac-4c99-8d2b-fb05d39a3638.25aeb8df-f536-4b11-8bd5-7f68bdf4b58e.vhdx%22,%20%22volume_id%22:%20%22d3184149-3bac-4c99-8d2b-fb05d39a3638%22%7D => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 12:51:39.265983 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6e0dc299-3601-46f7-ac38-a2f041ba3a1e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:39.267003 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6e0dc299-3601-46f7-ac38-a2f041ba3a1e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:39.273720 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6e0dc299-3601-46f7-ac38-a2f041ba3a1e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:39.274419 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6e0dc299-3601-46f7-ac38-a2f041ba3a1e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:39.275345 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6e0dc299-3601-46f7-ac38-a2f041ba3a1e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:39.275774 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6e0dc299-3601-46f7-ac38-a2f041ba3a1e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:39.348297 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6e0dc299-3601-46f7-ac38-a2f041ba3a1e tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "POST /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/action" status: 202 len: 0 microversion: 2.1 time: 0.086351 May 23 12:51:39.348924 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 291/585] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:51:39 2022] POST /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:51:39.359725 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-fea4d899-dfeb-4977-bc66-3df0188ab00a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:39.360149 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-fea4d899-dfeb-4977-bc66-3df0188ab00a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:39.367597 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fea4d899-dfeb-4977-bc66-3df0188ab00a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:39.369109 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fea4d899-dfeb-4977-bc66-3df0188ab00a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:39.369859 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fea4d899-dfeb-4977-bc66-3df0188ab00a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:39.370047 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fea4d899-dfeb-4977-bc66-3df0188ab00a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:39.606724 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fea4d899-dfeb-4977-bc66-3df0188ab00a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:39.614532 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-fea4d899-dfeb-4977-bc66-3df0188ab00a tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1750 microversion: 2.1 time: 0.259764 May 23 12:51:39.615100 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 295/586] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:39 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1750 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:51:40.225495 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-76c641ac-0341-4947-b0de-2bb37fede068 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:40.226076 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-76c641ac-0341-4947-b0de-2bb37fede068 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:40.232765 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-76c641ac-0341-4947-b0de-2bb37fede068 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:40.233237 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-76c641ac-0341-4947-b0de-2bb37fede068 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:40.233988 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-76c641ac-0341-4947-b0de-2bb37fede068 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:40.234420 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-76c641ac-0341-4947-b0de-2bb37fede068 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:40.314257 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-76c641ac-0341-4947-b0de-2bb37fede068 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lazy-loading 'services' on Instance uuid 3479c365-b079-47fd-892d-fa850e6d6951 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:51:40.387128 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-76c641ac-0341-4947-b0de-2bb37fede068 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951/os-volume_attachments/d3184149-3bac-4c99-8d2b-fb05d39a3638" status: 202 len: 0 microversion: 2.1 time: 0.165802 May 23 12:51:40.387739 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 292/587] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:51:40 2022] DELETE /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951/os-volume_attachments/d3184149-3bac-4c99-8d2b-fb05d39a3638 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:51:40.632256 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c02e73a8-b4d7-4726-9113-beba4a247b72 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:40.632853 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c02e73a8-b4d7-4726-9113-beba4a247b72 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:40.640135 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c02e73a8-b4d7-4726-9113-beba4a247b72 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:40.640569 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c02e73a8-b4d7-4726-9113-beba4a247b72 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:40.641378 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c02e73a8-b4d7-4726-9113-beba4a247b72 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:40.641801 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c02e73a8-b4d7-4726-9113-beba4a247b72 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:40.781953 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c02e73a8-b4d7-4726-9113-beba4a247b72 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:40.789945 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c02e73a8-b4d7-4726-9113-beba4a247b72 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1755 microversion: 2.1 time: 0.161429 May 23 12:51:40.790516 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 296/588] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:40 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:41.503103 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d761c4f8-3669-44e9-bfa4-d464d5d87e2d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:41.503687 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d761c4f8-3669-44e9-bfa4-d464d5d87e2d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:41.510953 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d761c4f8-3669-44e9-bfa4-d464d5d87e2d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:41.511408 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d761c4f8-3669-44e9-bfa4-d464d5d87e2d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:41.512164 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d761c4f8-3669-44e9-bfa4-d464d5d87e2d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:41.512597 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d761c4f8-3669-44e9-bfa4-d464d5d87e2d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:41.538336 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d761c4f8-3669-44e9-bfa4-d464d5d87e2d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Going to try to terminate instance {{(pid=134547) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:51:41.611746 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d761c4f8-3669-44e9-bfa4-d464d5d87e2d tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 204 len: 0 microversion: 2.1 time: 0.112356 May 23 12:51:41.612232 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 293/589] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:51:41 2022] DELETE /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:51:41.621908 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5c1664ad-3ce1-4532-ac74-e649ea97ee04 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:41.622513 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5c1664ad-3ce1-4532-ac74-e649ea97ee04 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:41.628473 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5c1664ad-3ce1-4532-ac74-e649ea97ee04 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:41.629055 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5c1664ad-3ce1-4532-ac74-e649ea97ee04 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:41.629847 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5c1664ad-3ce1-4532-ac74-e649ea97ee04 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:41.630277 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5c1664ad-3ce1-4532-ac74-e649ea97ee04 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:41.762260 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5c1664ad-3ce1-4532-ac74-e649ea97ee04 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:41.769736 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5c1664ad-3ce1-4532-ac74-e649ea97ee04 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1515 microversion: 2.1 time: 0.152979 May 23 12:51:41.770308 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 297/590] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:41 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:41.808364 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1f59b62f-daf1-48d7-8616-1f776355b289 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:41.809056 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1f59b62f-daf1-48d7-8616-1f776355b289 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:41.815450 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1f59b62f-daf1-48d7-8616-1f776355b289 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:41.815909 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1f59b62f-daf1-48d7-8616-1f776355b289 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:41.816638 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1f59b62f-daf1-48d7-8616-1f776355b289 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:41.817066 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1f59b62f-daf1-48d7-8616-1f776355b289 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:41.960407 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-1f59b62f-daf1-48d7-8616-1f776355b289 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:41.969123 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1f59b62f-daf1-48d7-8616-1f776355b289 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1755 microversion: 2.1 time: 0.165601 May 23 12:51:41.969713 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 294/591] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:41 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:42.787709 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-516415f7-4688-48d9-8124-80255fadafbb tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:42.788293 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-516415f7-4688-48d9-8124-80255fadafbb tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:42.795641 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-516415f7-4688-48d9-8124-80255fadafbb tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:42.796078 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-516415f7-4688-48d9-8124-80255fadafbb tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:42.796828 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-516415f7-4688-48d9-8124-80255fadafbb tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:42.797286 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-516415f7-4688-48d9-8124-80255fadafbb tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:42.924197 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-516415f7-4688-48d9-8124-80255fadafbb tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:42.932027 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-516415f7-4688-48d9-8124-80255fadafbb tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1515 microversion: 2.1 time: 0.148209 May 23 12:51:42.932589 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 298/592] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:42 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:42.986196 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b506b3d4-38df-400d-a7b4-50e9608f99ab tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:42.986799 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b506b3d4-38df-400d-a7b4-50e9608f99ab tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:42.993748 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b506b3d4-38df-400d-a7b4-50e9608f99ab tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:42.994189 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b506b3d4-38df-400d-a7b4-50e9608f99ab tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:42.994941 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b506b3d4-38df-400d-a7b4-50e9608f99ab tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:42.995373 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b506b3d4-38df-400d-a7b4-50e9608f99ab tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:43.136960 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b506b3d4-38df-400d-a7b4-50e9608f99ab tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:43.144945 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b506b3d4-38df-400d-a7b4-50e9608f99ab tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1755 microversion: 2.1 time: 0.162641 May 23 12:51:43.145553 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 295/593] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:42 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:43.949602 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-baf55589-e7cd-45e7-9140-e15682a62627 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:43.950259 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-baf55589-e7cd-45e7-9140-e15682a62627 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:43.956565 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-baf55589-e7cd-45e7-9140-e15682a62627 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:43.957002 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-baf55589-e7cd-45e7-9140-e15682a62627 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:43.957781 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-baf55589-e7cd-45e7-9140-e15682a62627 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:43.958207 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-baf55589-e7cd-45e7-9140-e15682a62627 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:44.093210 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-baf55589-e7cd-45e7-9140-e15682a62627 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:44.100894 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-baf55589-e7cd-45e7-9140-e15682a62627 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1515 microversion: 2.1 time: 0.155910 May 23 12:51:44.101602 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 299/594] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:43 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:44.161034 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8c7214a3-7f6b-452c-b5a3-6117458a97ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:44.161667 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8c7214a3-7f6b-452c-b5a3-6117458a97ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:44.164052 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=4 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:44.170245 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c7214a3-7f6b-452c-b5a3-6117458a97ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:44.170681 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c7214a3-7f6b-452c-b5a3-6117458a97ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:44.171427 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c7214a3-7f6b-452c-b5a3-6117458a97ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:44.171852 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c7214a3-7f6b-452c-b5a3-6117458a97ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:44.317835 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8c7214a3-7f6b-452c-b5a3-6117458a97ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:44.321426 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:44.326343 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8c7214a3-7f6b-452c-b5a3-6117458a97ed tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1755 microversion: 2.1 time: 0.169125 May 23 12:51:44.326915 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 296/595] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:44 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:44.895781 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-acf77107-5a79-4cb2-8d06-4e3f5e0cc756 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:44.896265 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-acf77107-5a79-4cb2-8d06-4e3f5e0cc756 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:44.902978 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-acf77107-5a79-4cb2-8d06-4e3f5e0cc756 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:44.903415 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-acf77107-5a79-4cb2-8d06-4e3f5e0cc756 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:44.904159 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-acf77107-5a79-4cb2-8d06-4e3f5e0cc756 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:44.904589 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-acf77107-5a79-4cb2-8d06-4e3f5e0cc756 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:44.933843 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-acf77107-5a79-4cb2-8d06-4e3f5e0cc756 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments/9fd5c4dd-5b8c-4542-acc2-7cffff9e3b23" status: 200 len: 194 microversion: 2.20 time: 0.042050 May 23 12:51:44.934405 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 300/596] 10.222.0.45 () {60 vars in 1453 bytes} [Mon May 23 12:51:44 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments/9fd5c4dd-5b8c-4542-acc2-7cffff9e3b23 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:51:44.996943 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f8b8aab6-987c-490b-9ac0-877b4f74956f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:44.997537 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f8b8aab6-987c-490b-9ac0-877b4f74956f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:45.004247 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f8b8aab6-987c-490b-9ac0-877b4f74956f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:45.004694 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f8b8aab6-987c-490b-9ac0-877b4f74956f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:45.005486 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f8b8aab6-987c-490b-9ac0-877b4f74956f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:45.005922 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f8b8aab6-987c-490b-9ac0-877b4f74956f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:45.085917 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-f8b8aab6-987c-490b-9ac0-877b4f74956f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lazy-loading 'services' on Instance uuid 0c365608-41a1-4663-b5e2-3481874a2325 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:51:45.118720 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-942d567a-a434-45dc-90a4-78c726a20e20 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:45.119611 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-942d567a-a434-45dc-90a4-78c726a20e20 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:45.126020 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-942d567a-a434-45dc-90a4-78c726a20e20 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:45.126465 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-942d567a-a434-45dc-90a4-78c726a20e20 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:45.127218 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-942d567a-a434-45dc-90a4-78c726a20e20 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:45.127651 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-942d567a-a434-45dc-90a4-78c726a20e20 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:45.159119 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f8b8aab6-987c-490b-9ac0-877b4f74956f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments/9fd5c4dd-5b8c-4542-acc2-7cffff9e3b23" status: 202 len: 0 microversion: 2.20 time: 0.166476 May 23 12:51:45.162902 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 297/597] 10.222.0.45 () {60 vars in 1456 bytes} [Mon May 23 12:51:44 2022] DELETE /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments/9fd5c4dd-5b8c-4542-acc2-7cffff9e3b23 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 12:51:45.169285 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-406eb9a9-c8e0-4c74-a921-0faabed69705 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:45.170350 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-406eb9a9-c8e0-4c74-a921-0faabed69705 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:45.177154 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-406eb9a9-c8e0-4c74-a921-0faabed69705 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:45.177597 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-406eb9a9-c8e0-4c74-a921-0faabed69705 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:45.178366 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-406eb9a9-c8e0-4c74-a921-0faabed69705 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:45.178797 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-406eb9a9-c8e0-4c74-a921-0faabed69705 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:45.210108 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-406eb9a9-c8e0-4c74-a921-0faabed69705 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045769 May 23 12:51:45.210675 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 298/598] 10.222.0.45 () {60 vars in 1342 bytes} [Mon May 23 12:51:45 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:51:45.266942 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-942d567a-a434-45dc-90a4-78c726a20e20 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:45.275140 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-942d567a-a434-45dc-90a4-78c726a20e20 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1515 microversion: 2.1 time: 0.160769 May 23 12:51:45.275746 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 301/599] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:45 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:51:45.343472 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9de7270c-d276-47af-b768-93ab94085373 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:45.344085 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9de7270c-d276-47af-b768-93ab94085373 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:45.350238 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9de7270c-d276-47af-b768-93ab94085373 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:45.350685 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9de7270c-d276-47af-b768-93ab94085373 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:45.351475 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9de7270c-d276-47af-b768-93ab94085373 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:45.352032 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9de7270c-d276-47af-b768-93ab94085373 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:45.495241 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9de7270c-d276-47af-b768-93ab94085373 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:45.503195 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9de7270c-d276-47af-b768-93ab94085373 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1755 microversion: 2.1 time: 0.163828 May 23 12:51:45.503760 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 299/600] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:45 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:46.222824 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2d379621-df95-4657-a73d-aa1dd5391854 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:46.223805 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2d379621-df95-4657-a73d-aa1dd5391854 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:46.230781 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2d379621-df95-4657-a73d-aa1dd5391854 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:46.231229 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2d379621-df95-4657-a73d-aa1dd5391854 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:46.231984 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2d379621-df95-4657-a73d-aa1dd5391854 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:46.232415 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2d379621-df95-4657-a73d-aa1dd5391854 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:46.267949 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2d379621-df95-4657-a73d-aa1dd5391854 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049113 May 23 12:51:46.268514 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 302/601] 10.222.0.45 () {60 vars in 1342 bytes} [Mon May 23 12:51:46 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:51:46.291710 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-360c44e6-ecdc-461e-97de-8b9f9957d814 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:46.292310 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-360c44e6-ecdc-461e-97de-8b9f9957d814 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:46.298645 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-360c44e6-ecdc-461e-97de-8b9f9957d814 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:46.299104 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-360c44e6-ecdc-461e-97de-8b9f9957d814 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:46.299842 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-360c44e6-ecdc-461e-97de-8b9f9957d814 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:46.300268 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-360c44e6-ecdc-461e-97de-8b9f9957d814 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:46.432674 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-360c44e6-ecdc-461e-97de-8b9f9957d814 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:46.440754 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-360c44e6-ecdc-461e-97de-8b9f9957d814 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1515 microversion: 2.1 time: 0.152846 May 23 12:51:46.441585 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 300/602] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:46 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:46.528966 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-15bce041-a4e1-48d2-879b-ccaf667a0b82 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:46.529563 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-15bce041-a4e1-48d2-879b-ccaf667a0b82 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:46.535554 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-15bce041-a4e1-48d2-879b-ccaf667a0b82 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:46.535991 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-15bce041-a4e1-48d2-879b-ccaf667a0b82 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:46.536735 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-15bce041-a4e1-48d2-879b-ccaf667a0b82 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:46.537245 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-15bce041-a4e1-48d2-879b-ccaf667a0b82 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:46.681656 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-15bce041-a4e1-48d2-879b-ccaf667a0b82 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:46.689481 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-15bce041-a4e1-48d2-879b-ccaf667a0b82 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1755 microversion: 2.1 time: 0.164313 May 23 12:51:46.690044 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 303/603] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:46 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:47.280560 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c3f147cc-c81c-40d5-8e97-d8314db216c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:47.281566 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c3f147cc-c81c-40d5-8e97-d8314db216c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:47.287492 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c3f147cc-c81c-40d5-8e97-d8314db216c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:47.287934 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c3f147cc-c81c-40d5-8e97-d8314db216c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:47.288677 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c3f147cc-c81c-40d5-8e97-d8314db216c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:47.290353 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c3f147cc-c81c-40d5-8e97-d8314db216c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:47.318856 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c3f147cc-c81c-40d5-8e97-d8314db216c7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042326 May 23 12:51:47.319435 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 301/604] 10.222.0.45 () {60 vars in 1342 bytes} [Mon May 23 12:51:47 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:51:47.459748 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f5fa1c1a-d046-4368-a9aa-c763629486aa tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:47.460380 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f5fa1c1a-d046-4368-a9aa-c763629486aa tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:47.464837 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=6 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:47.469085 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5fa1c1a-d046-4368-a9aa-c763629486aa tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:47.469805 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5fa1c1a-d046-4368-a9aa-c763629486aa tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:47.470612 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5fa1c1a-d046-4368-a9aa-c763629486aa tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:47.471211 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5fa1c1a-d046-4368-a9aa-c763629486aa tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:47.678845 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f5fa1c1a-d046-4368-a9aa-c763629486aa tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f6e3f8e0f2431888f20f91fb469c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138b75f9014a4698b462d0c7483b9420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:47.687918 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f5fa1c1a-d046-4368-a9aa-c763629486aa tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 200 len: 1515 microversion: 2.1 time: 0.233058 May 23 12:51:47.688745 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 304/605] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:47 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:47.707602 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8aca51cb-6443-4422-b1bf-b9437c699a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:47.708215 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8aca51cb-6443-4422-b1bf-b9437c699a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:47.714329 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8aca51cb-6443-4422-b1bf-b9437c699a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:47.715041 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8aca51cb-6443-4422-b1bf-b9437c699a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:47.715803 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8aca51cb-6443-4422-b1bf-b9437c699a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:47.716258 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8aca51cb-6443-4422-b1bf-b9437c699a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:47.864988 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-06b29865-b532-459b-809c-c58b20e1b73f req-0bcbc368-07cd-4740-96b3-9c6697baf5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3479c365-b079-47fd-892d-fa850e6d6951", "name": "network-vif-deleted", "tag": "d2463af3-71a7-41a4-b129-6fb247e9e617"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:47.874950 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-06b29865-b532-459b-809c-c58b20e1b73f req-0bcbc368-07cd-4740-96b3-9c6697baf5fe service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:47.875499 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-06b29865-b532-459b-809c-c58b20e1b73f req-0bcbc368-07cd-4740-96b3-9c6697baf5fe service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:47.887848 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-06b29865-b532-459b-809c-c58b20e1b73f req-0bcbc368-07cd-4740-96b3-9c6697baf5fe service nova] Creating event network-vif-deleted:d2463af3-71a7-41a4-b129-6fb247e9e617 for instance 3479c365-b079-47fd-892d-fa850e6d6951 on hv-cinder-maste May 23 12:51:47.893230 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-06b29865-b532-459b-809c-c58b20e1b73f req-0bcbc368-07cd-4740-96b3-9c6697baf5fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 May 23 12:51:47.894021 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 305/606] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:47.918801 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8aca51cb-6443-4422-b1bf-b9437c699a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:47.927400 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8aca51cb-6443-4422-b1bf-b9437c699a66 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1755 microversion: 2.1 time: 0.223619 May 23 12:51:47.927908 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 302/607] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:47 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:48.330716 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-79382af6-e904-4664-9eeb-367ee33c71d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:48.331842 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-79382af6-e904-4664-9eeb-367ee33c71d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:48.339045 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-79382af6-e904-4664-9eeb-367ee33c71d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:48.339746 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-79382af6-e904-4664-9eeb-367ee33c71d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:48.340513 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-79382af6-e904-4664-9eeb-367ee33c71d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:48.340981 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-79382af6-e904-4664-9eeb-367ee33c71d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:48.370432 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-79382af6-e904-4664-9eeb-367ee33c71d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043991 May 23 12:51:48.370970 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 306/608] 10.222.0.45 () {60 vars in 1342 bytes} [Mon May 23 12:51:48 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:48.427751 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-24067ba4-d968-41f9-80b0-61885afc72c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:48.428248 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-24067ba4-d968-41f9-80b0-61885afc72c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:48.434959 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-24067ba4-d968-41f9-80b0-61885afc72c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:48.435413 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-24067ba4-d968-41f9-80b0-61885afc72c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:48.436172 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-24067ba4-d968-41f9-80b0-61885afc72c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:48.436608 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-24067ba4-d968-41f9-80b0-61885afc72c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:48.462437 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-24067ba4-d968-41f9-80b0-61885afc72c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Going to try to terminate instance {{(pid=134547) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:51:48.534383 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-24067ba4-d968-41f9-80b0-61885afc72c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 204 len: 0 microversion: 2.20 time: 0.110293 May 23 12:51:48.534953 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 303/609] 10.222.0.45 () {60 vars in 1279 bytes} [Mon May 23 12:51:48 2022] DELETE /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 12:51:48.543251 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4ea912c0-709e-4a50-b6a6-fa40c6263ab2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:48.543852 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4ea912c0-709e-4a50-b6a6-fa40c6263ab2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:48.550128 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4ea912c0-709e-4a50-b6a6-fa40c6263ab2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:48.550563 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4ea912c0-709e-4a50-b6a6-fa40c6263ab2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:48.551305 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4ea912c0-709e-4a50-b6a6-fa40c6263ab2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:48.551730 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4ea912c0-709e-4a50-b6a6-fa40c6263ab2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:48.690040 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4ea912c0-709e-4a50-b6a6-fa40c6263ab2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:48.698513 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4ea912c0-709e-4a50-b6a6-fa40c6263ab2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:48.700329 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4ea912c0-709e-4a50-b6a6-fa40c6263ab2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:48.701512 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4ea912c0-709e-4a50-b6a6-fa40c6263ab2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.162351 May 23 12:51:48.702069 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 307/610] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:48 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:51:48.704971 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b8657bed-fe20-4e0a-a0f6-99e6be74d999 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:48.705689 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b8657bed-fe20-4e0a-a0f6-99e6be74d999 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] [instance: 3479c365-b079-47fd-892d-fa850e6d6951] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:48.712574 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8657bed-fe20-4e0a-a0f6-99e6be74d999 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:48.713038 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8657bed-fe20-4e0a-a0f6-99e6be74d999 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:48.713836 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8657bed-fe20-4e0a-a0f6-99e6be74d999 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:48.714308 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8657bed-fe20-4e0a-a0f6-99e6be74d999 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:48.727647 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-b8657bed-fe20-4e0a-a0f6-99e6be74d999 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] HTTP exception thrown: Instance 3479c365-b079-47fd-892d-fa850e6d6951 could not be found. May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b8657bed-fe20-4e0a-a0f6-99e6be74d999 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Request method failure captured: May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 HTTP/1.1 May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4LTJkyGfnTKy2-6-mbxxT-p7qSUEwYjUeuTbQOIx-YjRFuJJzfbhvMqnpVlDQ9Sh-bR_hJmt-JG9W_mOdEz3h8z70OLAPOVcqfYb-MgT1h_m4PiRiUrEHuEmbZND3BklxDq1cRFUTrDrlzRaHH2Euo8CzEFXPbZaNXqWn-ZZh0rCfE May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 138b75f9014a4698b462d0c7483b9420 May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-VolumesSnapshotTestJSON-259890111 May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:51:48.729262 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/138b75f9014a4698b462d0c7483b9420"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/138b75f9014a4698b462d0c7483b9420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/138b75f9014a4698b462d0c7483b9420"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_138b75f9014a4698b462d0c7483b9420"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-VolumesSnapshotTestJSON-259890111 May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 138b75f9014a4698b462d0c7483b9420 May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-259890111 May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-VolumesSnapshotTestJSON-259890111-project May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: b4f6e3f8e0f2431888f20f91fb469c72 May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-VolumesSnapshotTestJSON-259890111-project May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 3479c365-b079-47fd-892d-fa850e6d6951 could not be found. May 23 12:51:48.730848 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '3479c365-b079-47fd-892d-fa850e6d6951'} May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3479c365-b079-47fd-892d-fa850e6d6951 could not be found. May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:51:48.731788 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3479c365-b079-47fd-892d-fa850e6d6951 could not be found. May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3479c365-b079-47fd-892d-fa850e6d6951 could not be found. May 23 12:51:48.733320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:51:48.734539 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b8657bed-fe20-4e0a-a0f6-99e6be74d999 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] Returning 404 to user: Instance 3479c365-b079-47fd-892d-fa850e6d6951 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:51:48.734539 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b8657bed-fe20-4e0a-a0f6-99e6be74d999 tempest-VolumesSnapshotTestJSON-259890111 tempest-VolumesSnapshotTestJSON-259890111-project] 10.222.0.45 "GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951" status: 404 len: 111 microversion: 2.1 time: 0.029842 May 23 12:51:48.734539 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 304/611] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:48 2022] GET /compute/v2.1/servers/3479c365-b079-47fd-892d-fa850e6d6951 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:51:48.945052 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a78806ff-c41f-4b35-aad5-dfd44dabab0b tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:48.946530 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a78806ff-c41f-4b35-aad5-dfd44dabab0b tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:48.952952 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a78806ff-c41f-4b35-aad5-dfd44dabab0b tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:48.953652 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a78806ff-c41f-4b35-aad5-dfd44dabab0b tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:48.954487 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a78806ff-c41f-4b35-aad5-dfd44dabab0b tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:48.954833 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a78806ff-c41f-4b35-aad5-dfd44dabab0b tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:49.324147 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a78806ff-c41f-4b35-aad5-dfd44dabab0b tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:49.332162 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a78806ff-c41f-4b35-aad5-dfd44dabab0b tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1755 microversion: 2.1 time: 0.391011 May 23 12:51:49.332729 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 308/612] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:48 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1755 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:49.721045 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9d7b54c8-93a5-4a8f-b53c-ff764c82790c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:49.721672 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9d7b54c8-93a5-4a8f-b53c-ff764c82790c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:49.728829 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9d7b54c8-93a5-4a8f-b53c-ff764c82790c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:49.729294 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9d7b54c8-93a5-4a8f-b53c-ff764c82790c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:49.730040 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9d7b54c8-93a5-4a8f-b53c-ff764c82790c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:49.730469 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9d7b54c8-93a5-4a8f-b53c-ff764c82790c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:49.858564 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9d7b54c8-93a5-4a8f-b53c-ff764c82790c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:49.866417 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9d7b54c8-93a5-4a8f-b53c-ff764c82790c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:49.867914 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9d7b54c8-93a5-4a8f-b53c-ff764c82790c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:49.869057 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9d7b54c8-93a5-4a8f-b53c-ff764c82790c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.151926 May 23 12:51:49.869631 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 305/613] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:49 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:51:50.350108 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-72ea341b-9b46-4a4b-994e-4b60fc4a3742 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:50.350712 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-72ea341b-9b46-4a4b-994e-4b60fc4a3742 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:50.358196 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-72ea341b-9b46-4a4b-994e-4b60fc4a3742 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:50.358633 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-72ea341b-9b46-4a4b-994e-4b60fc4a3742 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:50.359382 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-72ea341b-9b46-4a4b-994e-4b60fc4a3742 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:50.359806 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-72ea341b-9b46-4a4b-994e-4b60fc4a3742 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:50.502509 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-72ea341b-9b46-4a4b-994e-4b60fc4a3742 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:50.511027 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-72ea341b-9b46-4a4b-994e-4b60fc4a3742 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1755 microversion: 2.1 time: 0.164802 May 23 12:51:50.511591 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 309/614] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:50 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:51:50.888089 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-aa0ab841-d20c-411b-b34e-e7544d55eabf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:50.888851 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-aa0ab841-d20c-411b-b34e-e7544d55eabf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:50.895311 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-aa0ab841-d20c-411b-b34e-e7544d55eabf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:50.895757 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-aa0ab841-d20c-411b-b34e-e7544d55eabf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:50.896523 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-aa0ab841-d20c-411b-b34e-e7544d55eabf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:50.896954 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-aa0ab841-d20c-411b-b34e-e7544d55eabf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:51.104303 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-aa0ab841-d20c-411b-b34e-e7544d55eabf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:51.112171 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-aa0ab841-d20c-411b-b34e-e7544d55eabf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:51.113744 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-aa0ab841-d20c-411b-b34e-e7544d55eabf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:51.114930 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-aa0ab841-d20c-411b-b34e-e7544d55eabf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1724 microversion: 2.20 time: 0.231009 May 23 12:51:51.115488 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 306/615] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:50 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:51:51.532805 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6ba91112-5cf5-4e56-83f4-c6c3c604205c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:51.534057 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6ba91112-5cf5-4e56-83f4-c6c3c604205c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:51.552156 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6ba91112-5cf5-4e56-83f4-c6c3c604205c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:51.552618 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6ba91112-5cf5-4e56-83f4-c6c3c604205c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:51.553456 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6ba91112-5cf5-4e56-83f4-c6c3c604205c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:51.553898 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6ba91112-5cf5-4e56-83f4-c6c3c604205c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:51.728116 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-71b72d0d-a56f-40d1-9132-33a6d3f6c938 req-a9ede2fe-e319-42c5-a218-1ed0608f8ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c365608-41a1-4663-b5e2-3481874a2325", "name": "network-vif-deleted", "tag": "fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:51.736636 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-71b72d0d-a56f-40d1-9132-33a6d3f6c938 req-a9ede2fe-e319-42c5-a218-1ed0608f8ed2 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:51.737244 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-71b72d0d-a56f-40d1-9132-33a6d3f6c938 req-a9ede2fe-e319-42c5-a218-1ed0608f8ed2 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:51.748320 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6ba91112-5cf5-4e56-83f4-c6c3c604205c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:51.752697 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=99 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:51:51.763942 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6ba91112-5cf5-4e56-83f4-c6c3c604205c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1755 microversion: 2.1 time: 0.239194 May 23 12:51:51.764631 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 310/616] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:51 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:51.916780 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-71b72d0d-a56f-40d1-9132-33a6d3f6c938 req-a9ede2fe-e319-42c5-a218-1ed0608f8ed2 service nova] Creating event network-vif-deleted:fc212d3e-776e-4dcd-aa46-5f5b10a2ffb1 for instance 0c365608-41a1-4663-b5e2-3481874a2325 on hv-cinder-maste May 23 12:51:51.923090 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-71b72d0d-a56f-40d1-9132-33a6d3f6c938 req-a9ede2fe-e319-42c5-a218-1ed0608f8ed2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198598 May 23 12:51:51.923770 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 307/617] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:51:52.133968 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:52.134984 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:52.141388 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:52.141924 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:52.142788 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:52.143285 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:52.176351 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:52.176797 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:52.177276 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lazy-loading 'fault' on Instance uuid 0c365608-41a1-4663-b5e2-3481874a2325 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:51:52.220563 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:52.229282 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:52.230815 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:52.231965 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1023c01e-e656-4b31-82a3-c03b1a088dd4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 200 len: 1372 microversion: 2.20 time: 0.102431 May 23 12:51:52.232522 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 311/618] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:52 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:51:52.782654 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8f954536-8420-4195-a21b-d57e8b107cbd tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:52.783975 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8f954536-8420-4195-a21b-d57e8b107cbd tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:52.790804 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8f954536-8420-4195-a21b-d57e8b107cbd tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:52.791248 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8f954536-8420-4195-a21b-d57e8b107cbd tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:52.792088 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8f954536-8420-4195-a21b-d57e8b107cbd tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:52.792577 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8f954536-8420-4195-a21b-d57e8b107cbd tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:52.994303 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8f954536-8420-4195-a21b-d57e8b107cbd tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:53.002414 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8f954536-8420-4195-a21b-d57e8b107cbd tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1758 microversion: 2.1 time: 0.224405 May 23 12:51:53.003022 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 308/619] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:51:52 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1758 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:51:53.250200 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-571e6e79-80a6-4634-962d-9fb8228602a7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:53.250796 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-571e6e79-80a6-4634-962d-9fb8228602a7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:53.257163 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-571e6e79-80a6-4634-962d-9fb8228602a7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:53.257622 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-571e6e79-80a6-4634-962d-9fb8228602a7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:53.258748 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-571e6e79-80a6-4634-962d-9fb8228602a7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:53.259181 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-571e6e79-80a6-4634-962d-9fb8228602a7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:53.272272 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-571e6e79-80a6-4634-962d-9fb8228602a7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] HTTP exception thrown: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-571e6e79-80a6-4634-962d-9fb8228602a7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Request method failure captured: May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 HTTP/1.1 May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J95yar1cPKmYO1burD_q_qz0QUWRFgZS2po2rlk5IQ4Qiyh4Ci327SEkX6d2x9eRq_q7JhKUl3nlbpC9s-ZF5WElZUnvRwtCwpqvEyuKDjqZYcQtMIU7mOiqg87opy5DnoYGyD30TcIKSzdqRZRqdBNiuIROENrVtgpGYIRtGm7ik May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: d6700b35745e4290b820f91719b249d4 May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:51:53.274792 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d6700b35745e4290b820f91719b249d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d6700b35745e4290b820f91719b249d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: d6700b35745e4290b820f91719b249d4 May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d23ca857b76540ce83053424b710697b May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:51:53.276397 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': '0c365608-41a1-4663-b5e2-3481874a2325'} May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:51:53.277416 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:51:53.278840 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:51:53.280252 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-571e6e79-80a6-4634-962d-9fb8228602a7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Returning 404 to user: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:51:53.280252 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-571e6e79-80a6-4634-962d-9fb8228602a7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 404 len: 111 microversion: 2.20 time: 0.029824 May 23 12:51:53.280252 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 312/620] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:53 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:51:53.284828 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-69a0a776-c7aa-4972-b881-e8587ded9920 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '.version_select at 0x7f6a36a8cf70>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:53.302331 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-69a0a776-c7aa-4972-b881-e8587ded9920 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956396379" status: 204 len: 0 microversion: 2.20 time: 0.021366 May 23 12:51:53.302940 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 309/621] 10.222.0.45 () {60 vars in 1261 bytes} [Mon May 23 12:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956396379 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 23 12:51:53.956648 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5d1b3863-0e4f-4b84-a710-af61253b8753 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Action: 'create', calling method: .version_select at 0x7f6a36c0ba60>, body: {"keypair": {"name": "tempest-keypair-1426581192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB64RseXc2bwp5ZnKpBtgXbRg4jF8vmQO29H4TtO/cuKHfLp9AlGJ/oAiwrjNLuU2WyPK/CrgFuLJBOIJ1WnlkpKYb7aLD38PMb3mEz5hKIBVT9PtXHWcy2WcPpWBM5SCg=="}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:53.971069 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-5d1b3863-0e4f-4b84-a710-af61253b8753 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Getting quotas for project d6700b35745e4290b820f91719b249d4. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:51:53.975012 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-5d1b3863-0e4f-4b84-a710-af61253b8753 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Getting quotas for user d23ca857b76540ce83053424b710697b and project d6700b35745e4290b820f91719b249d4. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:51:54.011033 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5d1b3863-0e4f-4b84-a710-af61253b8753 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.058214 May 23 12:51:54.011816 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 313/622] 10.222.0.45 () {62 vars in 1199 bytes} [Mon May 23 12:51:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 12:51:55.306218 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-456223085", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "971dea61-5b31-4843-b112-31eacccec712"}], "security_groups": [{"name": "tempest-securitygroup--497574118"}], "key_name": "tempest-keypair-1426581192", "user_data": "}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:55.419830 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] validate_networks() for [('971dea61-5b31-4843-b112-31eacccec712', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:51:55.803890 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:51:55.804306 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:51:55.804883 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:51:55.805322 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:51:55.805726 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:51:55.814353 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:55.814789 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:55.815568 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:55.815995 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:55.832683 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Getting quotas for project d6700b35745e4290b820f91719b249d4. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:51:55.837374 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Getting quotas for user d23ca857b76540ce83053424b710697b and project d6700b35745e4290b820f91719b249d4. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:51:55.848313 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:51:55.850551 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:51:55.895948 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-77b5b0c0-b8a7-4716-93bc-d5d9fd0ac5c6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.595206 May 23 12:51:55.896595 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 310/623] 10.222.0.45 () {62 vars in 1187 bytes} [Mon May 23 12:51:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 12:51:55.907603 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-65699815-9064-4eaa-a242-942179cfd980 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:55.908419 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-65699815-9064-4eaa-a242-942179cfd980 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:55.963279 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-65699815-9064-4eaa-a242-942179cfd980 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:55.970734 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-65699815-9064-4eaa-a242-942179cfd980 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:55.972227 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-65699815-9064-4eaa-a242-942179cfd980 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:55.973423 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-65699815-9064-4eaa-a242-942179cfd980 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1281 microversion: 2.20 time: 0.069947 May 23 12:51:55.974381 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 314/624] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:55 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:51:56.991472 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d3a0480a-873a-49d1-a6c2-e76a108f2a0f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:56.992740 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d3a0480a-873a-49d1-a6c2-e76a108f2a0f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:56.998935 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d3a0480a-873a-49d1-a6c2-e76a108f2a0f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:56.999383 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d3a0480a-873a-49d1-a6c2-e76a108f2a0f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:57.000147 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d3a0480a-873a-49d1-a6c2-e76a108f2a0f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:57.000586 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d3a0480a-873a-49d1-a6c2-e76a108f2a0f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:57.061533 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d3a0480a-873a-49d1-a6c2-e76a108f2a0f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:57.069853 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d3a0480a-873a-49d1-a6c2-e76a108f2a0f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:57.072206 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d3a0480a-873a-49d1-a6c2-e76a108f2a0f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:57.073335 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d3a0480a-873a-49d1-a6c2-e76a108f2a0f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1339 microversion: 2.20 time: 0.086291 May 23 12:51:57.073887 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 311/625] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:56 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:51:58.096927 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e12e54c1-f480-4a88-938f-ecd788440038 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:58.097771 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e12e54c1-f480-4a88-938f-ecd788440038 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:58.110904 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e12e54c1-f480-4a88-938f-ecd788440038 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:58.111470 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e12e54c1-f480-4a88-938f-ecd788440038 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:58.112413 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e12e54c1-f480-4a88-938f-ecd788440038 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:58.112955 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e12e54c1-f480-4a88-938f-ecd788440038 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:58.283078 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e12e54c1-f480-4a88-938f-ecd788440038 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:58.293036 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e12e54c1-f480-4a88-938f-ecd788440038 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:58.295085 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e12e54c1-f480-4a88-938f-ecd788440038 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:58.296304 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e12e54c1-f480-4a88-938f-ecd788440038 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1406 microversion: 2.20 time: 0.207022 May 23 12:51:58.296995 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 315/626] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:58 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:51:58.313830 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-756431f0-380d-4114-9d19-57b517c45190 req-21d84b7f-f99a-4f70-9016-c9f68fac7109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2", "tag": "09a5c406-d2e6-4886-a574-22f77e9b109c"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:58.323080 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-756431f0-380d-4114-9d19-57b517c45190 req-21d84b7f-f99a-4f70-9016-c9f68fac7109 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:58.323574 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-756431f0-380d-4114-9d19-57b517c45190 req-21d84b7f-f99a-4f70-9016-c9f68fac7109 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:58.335369 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-756431f0-380d-4114-9d19-57b517c45190 req-21d84b7f-f99a-4f70-9016-c9f68fac7109 service nova] Creating event network-changed:09a5c406-d2e6-4886-a574-22f77e9b109c for instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 on hv-cinder-maste May 23 12:51:58.340594 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-756431f0-380d-4114-9d19-57b517c45190 req-21d84b7f-f99a-4f70-9016-c9f68fac7109 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031275 May 23 12:51:58.341568 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 312/627] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:51:59.193217 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3ae86fe9-6e94-4e84-9850-dce72900ef64 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e60cb3a4-5dfa-4318-8753-dbaecb3e4e11"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:51:59.194377 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3ae86fe9-6e94-4e84-9850-dce72900ef64 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:59.202020 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ae86fe9-6e94-4e84-9850-dce72900ef64 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:59.202574 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ae86fe9-6e94-4e84-9850-dce72900ef64 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:59.203652 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ae86fe9-6e94-4e84-9850-dce72900ef64 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:59.204180 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3ae86fe9-6e94-4e84-9850-dce72900ef64 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:59.315852 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-776692d6-4821-47aa-bfb4-cff0a2e18a7c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:51:59.316535 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-776692d6-4821-47aa-bfb4-cff0a2e18a7c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:51:59.322916 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-776692d6-4821-47aa-bfb4-cff0a2e18a7c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:59.323362 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-776692d6-4821-47aa-bfb4-cff0a2e18a7c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:59.324117 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-776692d6-4821-47aa-bfb4-cff0a2e18a7c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:51:59.324553 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-776692d6-4821-47aa-bfb4-cff0a2e18a7c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:51:59.454835 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-776692d6-4821-47aa-bfb4-cff0a2e18a7c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:59.463217 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-776692d6-4821-47aa-bfb4-cff0a2e18a7c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:59.464956 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-776692d6-4821-47aa-bfb4-cff0a2e18a7c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:51:59.466083 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-776692d6-4821-47aa-bfb4-cff0a2e18a7c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1406 microversion: 2.20 time: 0.154601 May 23 12:51:59.466628 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 313/628] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:51:59 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:51:59.815317 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3ae86fe9-6e94-4e84-9850-dce72900ef64 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626075 May 23 12:51:59.816083 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 316/629] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:51:59 2022] POST /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:00.483616 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5d121d67-36cb-41f8-be33-d9e822455c58 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:00.484218 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5d121d67-36cb-41f8-be33-d9e822455c58 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:00.490665 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d121d67-36cb-41f8-be33-d9e822455c58 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:00.491105 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d121d67-36cb-41f8-be33-d9e822455c58 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:00.491872 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d121d67-36cb-41f8-be33-d9e822455c58 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:00.492957 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d121d67-36cb-41f8-be33-d9e822455c58 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:00.641622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5d121d67-36cb-41f8-be33-d9e822455c58 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:00.645131 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:00.652103 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5d121d67-36cb-41f8-be33-d9e822455c58 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:00.653718 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5d121d67-36cb-41f8-be33-d9e822455c58 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:00.654928 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5d121d67-36cb-41f8-be33-d9e822455c58 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1406 microversion: 2.20 time: 0.175285 May 23 12:52:00.655661 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 314/630] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:52:00 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:52:01.674865 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d48d2a51-989f-4e5f-b813-cf4aee045211 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:01.675472 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d48d2a51-989f-4e5f-b813-cf4aee045211 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:01.681705 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d48d2a51-989f-4e5f-b813-cf4aee045211 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:01.682149 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d48d2a51-989f-4e5f-b813-cf4aee045211 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:01.682934 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d48d2a51-989f-4e5f-b813-cf4aee045211 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:01.683365 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d48d2a51-989f-4e5f-b813-cf4aee045211 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:01.821602 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d48d2a51-989f-4e5f-b813-cf4aee045211 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:01.829641 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d48d2a51-989f-4e5f-b813-cf4aee045211 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:01.831140 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d48d2a51-989f-4e5f-b813-cf4aee045211 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:01.832243 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d48d2a51-989f-4e5f-b813-cf4aee045211 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1406 microversion: 2.20 time: 0.162287 May 23 12:52:01.832805 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 317/631] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:52:01 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:52:02.044207 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ff09a945-0041-42ce-b538-81fc5d9d6af5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:02.045168 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ff09a945-0041-42ce-b538-81fc5d9d6af5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:02.052617 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ff09a945-0041-42ce-b538-81fc5d9d6af5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:02.053061 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ff09a945-0041-42ce-b538-81fc5d9d6af5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:02.053854 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ff09a945-0041-42ce-b538-81fc5d9d6af5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:02.054288 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ff09a945-0041-42ce-b538-81fc5d9d6af5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:02.078689 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-ff09a945-0041-42ce-b538-81fc5d9d6af5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lazy-loading 'flavor' on Instance uuid 67a42629-21e9-4985-9f40-50fcb8ac70a5 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:52:02.201207 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ff09a945-0041-42ce-b538-81fc5d9d6af5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/action" status: 200 len: 32 microversion: 2.1 time: 0.160728 May 23 12:52:02.201716 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 315/632] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:52:02 2022] POST /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:52:02.211921 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9469fae5-3a33-4a7d-af0e-75969ec1c192 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:02.212607 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-9469fae5-3a33-4a7d-af0e-75969ec1c192 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:02.219504 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9469fae5-3a33-4a7d-af0e-75969ec1c192 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:02.219937 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9469fae5-3a33-4a7d-af0e-75969ec1c192 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:02.221183 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9469fae5-3a33-4a7d-af0e-75969ec1c192 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:02.221945 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9469fae5-3a33-4a7d-af0e-75969ec1c192 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:02.359542 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9469fae5-3a33-4a7d-af0e-75969ec1c192 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:02.367971 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-9469fae5-3a33-4a7d-af0e-75969ec1c192 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.160373 May 23 12:52:02.368539 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 318/633] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:02 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:02.851778 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5b176450-c2c5-4ddf-ab83-1639746980c1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:02.852585 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5b176450-c2c5-4ddf-ab83-1639746980c1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:02.859404 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5b176450-c2c5-4ddf-ab83-1639746980c1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:02.859950 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5b176450-c2c5-4ddf-ab83-1639746980c1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:02.860613 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5b176450-c2c5-4ddf-ab83-1639746980c1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:02.861046 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5b176450-c2c5-4ddf-ab83-1639746980c1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:02.928931 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-1d05d544-b5cb-4b75-b053-b877e97aa3b7 req-e416dd48-4ab4-4cfa-ad48-342a9d0b6caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2", "name": "network-vif-plugged", "status": "completed", "tag": "09a5c406-d2e6-4886-a574-22f77e9b109c"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:02.939167 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-1d05d544-b5cb-4b75-b053-b877e97aa3b7 req-e416dd48-4ab4-4cfa-ad48-342a9d0b6caf service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:02.939870 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-1d05d544-b5cb-4b75-b053-b877e97aa3b7 req-e416dd48-4ab4-4cfa-ad48-342a9d0b6caf service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:02.958536 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-1d05d544-b5cb-4b75-b053-b877e97aa3b7 req-e416dd48-4ab4-4cfa-ad48-342a9d0b6caf service nova] Creating event network-vif-plugged:09a5c406-d2e6-4886-a574-22f77e9b109c for instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 on hv-cinder-maste May 23 12:52:02.964911 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-1d05d544-b5cb-4b75-b053-b877e97aa3b7 req-e416dd48-4ab4-4cfa-ad48-342a9d0b6caf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039579 May 23 12:52:02.966048 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 319/634] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:52:03.005696 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5b176450-c2c5-4ddf-ab83-1639746980c1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:03.015490 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5b176450-c2c5-4ddf-ab83-1639746980c1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:03.017880 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5b176450-c2c5-4ddf-ab83-1639746980c1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:03.019017 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5b176450-c2c5-4ddf-ab83-1639746980c1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1406 microversion: 2.20 time: 0.171637 May 23 12:52:03.019570 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 316/635] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:52:02 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:52:03.386236 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ca386bbc-7c60-4573-8510-dbf7f0f5b431 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:03.386922 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ca386bbc-7c60-4573-8510-dbf7f0f5b431 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:03.393008 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca386bbc-7c60-4573-8510-dbf7f0f5b431 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:03.393486 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca386bbc-7c60-4573-8510-dbf7f0f5b431 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:03.394237 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca386bbc-7c60-4573-8510-dbf7f0f5b431 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:03.394667 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ca386bbc-7c60-4573-8510-dbf7f0f5b431 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:03.528098 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ca386bbc-7c60-4573-8510-dbf7f0f5b431 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:03.536926 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ca386bbc-7c60-4573-8510-dbf7f0f5b431 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.155404 May 23 12:52:03.537620 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 320/636] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:03 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:04.037719 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-bdf108e1-a7d0-455f-8680-26a4a94d2cc9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:04.038317 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-bdf108e1-a7d0-455f-8680-26a4a94d2cc9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:04.044853 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bdf108e1-a7d0-455f-8680-26a4a94d2cc9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:04.045348 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bdf108e1-a7d0-455f-8680-26a4a94d2cc9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:04.046101 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bdf108e1-a7d0-455f-8680-26a4a94d2cc9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:04.046533 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bdf108e1-a7d0-455f-8680-26a4a94d2cc9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:04.177077 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-bdf108e1-a7d0-455f-8680-26a4a94d2cc9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:04.185622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-bdf108e1-a7d0-455f-8680-26a4a94d2cc9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:04.187125 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-bdf108e1-a7d0-455f-8680-26a4a94d2cc9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:04.188218 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-bdf108e1-a7d0-455f-8680-26a4a94d2cc9 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1406 microversion: 2.20 time: 0.154574 May 23 12:52:04.188777 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 317/637] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:52:04 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:52:04.556254 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-91a15a19-fdc1-4aea-b18a-7b49e473d1b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:04.556905 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-91a15a19-fdc1-4aea-b18a-7b49e473d1b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:04.563311 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-91a15a19-fdc1-4aea-b18a-7b49e473d1b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:04.563749 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-91a15a19-fdc1-4aea-b18a-7b49e473d1b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:04.564497 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-91a15a19-fdc1-4aea-b18a-7b49e473d1b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:04.564918 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-91a15a19-fdc1-4aea-b18a-7b49e473d1b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:04.691456 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-91a15a19-fdc1-4aea-b18a-7b49e473d1b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:04.699743 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-91a15a19-fdc1-4aea-b18a-7b49e473d1b0 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.148189 May 23 12:52:04.700303 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 321/638] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:04 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:05.206430 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0d761182-3bda-4dc5-8287-24445e633f17 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:05.207037 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0d761182-3bda-4dc5-8287-24445e633f17 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:05.209523 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:05.216259 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d761182-3bda-4dc5-8287-24445e633f17 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:05.216702 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d761182-3bda-4dc5-8287-24445e633f17 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:05.217495 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d761182-3bda-4dc5-8287-24445e633f17 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:05.217927 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0d761182-3bda-4dc5-8287-24445e633f17 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:05.351859 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0d761182-3bda-4dc5-8287-24445e633f17 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:05.359711 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0d761182-3bda-4dc5-8287-24445e633f17 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:05.361226 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0d761182-3bda-4dc5-8287-24445e633f17 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:05.362372 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0d761182-3bda-4dc5-8287-24445e633f17 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1598 microversion: 2.20 time: 0.160243 May 23 12:52:05.362922 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 318/639] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:52:05 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:52:05.380020 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-775b4dbd-26b0-4972-98fd-54270a2715e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:05.380507 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-775b4dbd-26b0-4972-98fd-54270a2715e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:05.387139 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-775b4dbd-26b0-4972-98fd-54270a2715e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:05.387587 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-775b4dbd-26b0-4972-98fd-54270a2715e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:05.388334 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-775b4dbd-26b0-4972-98fd-54270a2715e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:05.388761 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-775b4dbd-26b0-4972-98fd-54270a2715e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:05.465343 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-775b4dbd-26b0-4972-98fd-54270a2715e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088982 May 23 12:52:05.465947 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 322/640] 10.222.0.45 () {60 vars in 1315 bytes} [Mon May 23 12:52:05 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:52:05.717644 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-863c5298-53ec-4642-a909-0e70a8b74353 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:05.718248 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-863c5298-53ec-4642-a909-0e70a8b74353 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:05.724085 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-863c5298-53ec-4642-a909-0e70a8b74353 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:05.724528 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-863c5298-53ec-4642-a909-0e70a8b74353 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:05.725309 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-863c5298-53ec-4642-a909-0e70a8b74353 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:05.725744 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-863c5298-53ec-4642-a909-0e70a8b74353 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:05.823517 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:05.844322 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=6 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:05.860253 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-863c5298-53ec-4642-a909-0e70a8b74353 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:05.868744 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-863c5298-53ec-4642-a909-0e70a8b74353 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.155128 May 23 12:52:05.869529 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 319/641] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:05 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:06.420794 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=6 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:06.425042 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-f9d5743f-c309-4088-b4a9-c16033bc9b11 req-0489ae55-7450-4080-b793-eba4ec94e09a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2", "tag": "09a5c406-d2e6-4886-a574-22f77e9b109c"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:06.438266 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-f9d5743f-c309-4088-b4a9-c16033bc9b11 req-0489ae55-7450-4080-b793-eba4ec94e09a service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:06.439079 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-f9d5743f-c309-4088-b4a9-c16033bc9b11 req-0489ae55-7450-4080-b793-eba4ec94e09a service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:06.452301 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-f9d5743f-c309-4088-b4a9-c16033bc9b11 req-0489ae55-7450-4080-b793-eba4ec94e09a service nova] Creating event network-changed:09a5c406-d2e6-4886-a574-22f77e9b109c for instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 on hv-cinder-maste May 23 12:52:06.457909 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-f9d5743f-c309-4088-b4a9-c16033bc9b11 req-0489ae55-7450-4080-b793-eba4ec94e09a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038199 May 23 12:52:06.459132 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 323/642] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:06.888807 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8aa0a48f-b397-4406-89b2-b9f6cabf3559 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:06.889542 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8aa0a48f-b397-4406-89b2-b9f6cabf3559 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:06.898391 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8aa0a48f-b397-4406-89b2-b9f6cabf3559 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:06.899077 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8aa0a48f-b397-4406-89b2-b9f6cabf3559 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:06.900092 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8aa0a48f-b397-4406-89b2-b9f6cabf3559 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:06.900732 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8aa0a48f-b397-4406-89b2-b9f6cabf3559 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:07.142197 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8aa0a48f-b397-4406-89b2-b9f6cabf3559 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:07.150556 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8aa0a48f-b397-4406-89b2-b9f6cabf3559 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.268174 May 23 12:52:07.160621 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 320/643] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:06 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:52:07.565157 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-436cee57-d2a9-46ef-b92b-b84d0f0bbf18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:07.565884 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-436cee57-d2a9-46ef-b92b-b84d0f0bbf18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:07.568614 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:07.579288 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-436cee57-d2a9-46ef-b92b-b84d0f0bbf18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:07.579670 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-436cee57-d2a9-46ef-b92b-b84d0f0bbf18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:07.580469 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-436cee57-d2a9-46ef-b92b-b84d0f0bbf18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:07.581018 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-436cee57-d2a9-46ef-b92b-b84d0f0bbf18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:07.605398 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-436cee57-d2a9-46ef-b92b-b84d0f0bbf18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/ips" status: 200 len: 151 microversion: 2.1 time: 0.045316 May 23 12:52:07.605975 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 324/644] 10.222.0.45 () {58 vars in 1247 bytes} [Mon May 23 12:52:07 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:08.168334 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e697f92a-bdbe-47dc-a950-f1f71a2f4d50 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:08.169215 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e697f92a-bdbe-47dc-a950-f1f71a2f4d50 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:08.175823 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e697f92a-bdbe-47dc-a950-f1f71a2f4d50 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:08.176275 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e697f92a-bdbe-47dc-a950-f1f71a2f4d50 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:08.177043 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e697f92a-bdbe-47dc-a950-f1f71a2f4d50 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:08.177512 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e697f92a-bdbe-47dc-a950-f1f71a2f4d50 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:08.328849 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e697f92a-bdbe-47dc-a950-f1f71a2f4d50 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:08.338016 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e697f92a-bdbe-47dc-a950-f1f71a2f4d50 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.173606 May 23 12:52:08.338690 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 321/645] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:08 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:08.937083 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c9a19f2e-59af-4822-af13-13f6866f5142 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6312157d-a7c8-4048-b978-d66101ca62a5"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:08.938183 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c9a19f2e-59af-4822-af13-13f6866f5142 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:08.945438 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c9a19f2e-59af-4822-af13-13f6866f5142 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:08.945881 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c9a19f2e-59af-4822-af13-13f6866f5142 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:08.946734 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c9a19f2e-59af-4822-af13-13f6866f5142 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:08.947163 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c9a19f2e-59af-4822-af13-13f6866f5142 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:09.186318 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c9a19f2e-59af-4822-af13-13f6866f5142 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252842 May 23 12:52:09.187583 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 325/646] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:52:08 2022] POST /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:09.356370 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-13c2f75c-c91f-4ea1-98ba-98edf657850c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:09.357183 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-13c2f75c-c91f-4ea1-98ba-98edf657850c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:09.363687 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-13c2f75c-c91f-4ea1-98ba-98edf657850c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:09.364138 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-13c2f75c-c91f-4ea1-98ba-98edf657850c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:09.364974 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-13c2f75c-c91f-4ea1-98ba-98edf657850c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:09.365551 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-13c2f75c-c91f-4ea1-98ba-98edf657850c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:09.508846 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-13c2f75c-c91f-4ea1-98ba-98edf657850c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:09.519531 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-13c2f75c-c91f-4ea1-98ba-98edf657850c tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.167363 May 23 12:52:09.520200 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 322/647] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:09 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:10.538338 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-55706d31-50bc-4146-8ae0-7afffff4359f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:10.539631 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-55706d31-50bc-4146-8ae0-7afffff4359f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:10.547990 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-55706d31-50bc-4146-8ae0-7afffff4359f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:10.548438 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-55706d31-50bc-4146-8ae0-7afffff4359f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:10.549222 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-55706d31-50bc-4146-8ae0-7afffff4359f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:10.549653 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-55706d31-50bc-4146-8ae0-7afffff4359f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:10.684209 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-55706d31-50bc-4146-8ae0-7afffff4359f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:10.692230 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-55706d31-50bc-4146-8ae0-7afffff4359f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.158173 May 23 12:52:10.693079 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 326/648] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:10 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:11.419653 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-dfe48683-3975-4024-9d9d-2e8f36292bc2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6312157d-a7c8-4048-b978-d66101ca62a5"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:11.420752 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-dfe48683-3975-4024-9d9d-2e8f36292bc2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:11.427221 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dfe48683-3975-4024-9d9d-2e8f36292bc2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:11.427600 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dfe48683-3975-4024-9d9d-2e8f36292bc2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:11.428342 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dfe48683-3975-4024-9d9d-2e8f36292bc2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:11.428766 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dfe48683-3975-4024-9d9d-2e8f36292bc2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:11.507103 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-dfe48683-3975-4024-9d9d-2e8f36292bc2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Invalid volume: volume 6312157d-a7c8-4048-b978-d66101ca62a5 is already attached to instances: 9218894f-57e2-4c73-9114-84275fabe11e May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-dfe48683-3975-4024-9d9d-2e8f36292bc2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: POST /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments HTTP/1.1 May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 74 May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:52:11.508865 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: {"volumeAttachment": {"volumeId": "6312157d-a7c8-4048-b978-d66101ca62a5"}} May 23 12:52:11.510588 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Invalid volume: volume 6312157d-a7c8-4048-b978-d66101ca62a5 is already attached to instances: 9218894f-57e2-4c73-9114-84275fabe11e May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'server_id': '9218894f-57e2-4c73-9114-84275fabe11e', 'body': {'volumeAttachment': {'volumeId': '6312157d-a7c8-4048-b978-d66101ca62a5'}}} May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6312157d-a7c8-4048-b978-d66101ca62a5 is already attached to instances: 9218894f-57e2-4c73-9114-84275fabe11e May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:11.511514 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6312157d-a7c8-4048-b978-d66101ca62a5 is already attached to instances: 9218894f-57e2-4c73-9114-84275fabe11e May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:11.512938 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:52:11.514321 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:52:11.514321 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:52:11.514321 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:52:11.514321 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6312157d-a7c8-4048-b978-d66101ca62a5 is already attached to instances: 9218894f-57e2-4c73-9114-84275fabe11e May 23 12:52:11.514321 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:11.514321 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-dfe48683-3975-4024-9d9d-2e8f36292bc2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 400 to user: Invalid volume: volume 6312157d-a7c8-4048-b978-d66101ca62a5 is already attached to instances: 9218894f-57e2-4c73-9114-84275fabe11e {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:52:11.514321 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-dfe48683-3975-4024-9d9d-2e8f36292bc2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094817 May 23 12:52:11.514321 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 323/649] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:52:11 2022] POST /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 12:52:11.571580 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a1b15196-9f08-40c3-8978-80bd608425b3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:11.572058 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a1b15196-9f08-40c3-8978-80bd608425b3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:11.578473 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a1b15196-9f08-40c3-8978-80bd608425b3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:11.578918 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a1b15196-9f08-40c3-8978-80bd608425b3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:11.579675 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a1b15196-9f08-40c3-8978-80bd608425b3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:11.580109 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a1b15196-9f08-40c3-8978-80bd608425b3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:11.664518 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-a1b15196-9f08-40c3-8978-80bd608425b3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lazy-loading 'services' on Instance uuid 9218894f-57e2-4c73-9114-84275fabe11e {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:52:11.709244 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-dc4ce7c9-d19e-4746-b29e-ef9f4e497f76 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:11.709849 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-dc4ce7c9-d19e-4746-b29e-ef9f4e497f76 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:11.716960 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dc4ce7c9-d19e-4746-b29e-ef9f4e497f76 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:11.717387 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dc4ce7c9-d19e-4746-b29e-ef9f4e497f76 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:11.718187 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dc4ce7c9-d19e-4746-b29e-ef9f4e497f76 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:11.718755 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-dc4ce7c9-d19e-4746-b29e-ef9f4e497f76 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:11.736746 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a1b15196-9f08-40c3-8978-80bd608425b3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments/6312157d-a7c8-4048-b978-d66101ca62a5" status: 202 len: 0 microversion: 2.1 time: 0.169169 May 23 12:52:11.737377 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 327/650] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:52:11 2022] DELETE /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments/6312157d-a7c8-4048-b978-d66101ca62a5 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:52:11.746774 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8cf51f17-2834-4afa-b57d-e45a65326f4e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:11.747892 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8cf51f17-2834-4afa-b57d-e45a65326f4e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:11.754516 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8cf51f17-2834-4afa-b57d-e45a65326f4e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:11.754915 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8cf51f17-2834-4afa-b57d-e45a65326f4e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:11.755705 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8cf51f17-2834-4afa-b57d-e45a65326f4e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:11.756187 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8cf51f17-2834-4afa-b57d-e45a65326f4e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:11.773648 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:11.794160 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8cf51f17-2834-4afa-b57d-e45a65326f4e tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051842 May 23 12:52:11.794742 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 328/651] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:52:11 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:52:11.871313 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-dc4ce7c9-d19e-4746-b29e-ef9f4e497f76 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:11.879889 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-dc4ce7c9-d19e-4746-b29e-ef9f4e497f76 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.174452 May 23 12:52:11.880439 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 324/652] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:11 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:52:12.805856 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a8cbeb48-7f37-4155-a617-8131bb6303d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:12.806739 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a8cbeb48-7f37-4155-a617-8131bb6303d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:12.813860 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a8cbeb48-7f37-4155-a617-8131bb6303d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:12.814304 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a8cbeb48-7f37-4155-a617-8131bb6303d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:12.815064 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a8cbeb48-7f37-4155-a617-8131bb6303d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:12.815519 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a8cbeb48-7f37-4155-a617-8131bb6303d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:12.844513 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a8cbeb48-7f37-4155-a617-8131bb6303d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042652 May 23 12:52:12.845061 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 329/653] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:52:12 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:52:12.897253 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3d5223dc-72c8-47e7-88d3-8ac7d9839c61 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:12.898433 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3d5223dc-72c8-47e7-88d3-8ac7d9839c61 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:12.901631 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6fb75a8b-32fe-4327-af65-4aae8c2f68e1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:12.902149 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6fb75a8b-32fe-4327-af65-4aae8c2f68e1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:12.905009 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d5223dc-72c8-47e7-88d3-8ac7d9839c61 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:12.905490 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d5223dc-72c8-47e7-88d3-8ac7d9839c61 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:12.906258 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d5223dc-72c8-47e7-88d3-8ac7d9839c61 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:12.906699 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d5223dc-72c8-47e7-88d3-8ac7d9839c61 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:12.908022 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6fb75a8b-32fe-4327-af65-4aae8c2f68e1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:12.908481 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6fb75a8b-32fe-4327-af65-4aae8c2f68e1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:12.909276 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6fb75a8b-32fe-4327-af65-4aae8c2f68e1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:12.909708 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6fb75a8b-32fe-4327-af65-4aae8c2f68e1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:12.937596 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6fb75a8b-32fe-4327-af65-4aae8c2f68e1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:52:13.029251 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6fb75a8b-32fe-4327-af65-4aae8c2f68e1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 204 len: 0 microversion: 2.1 time: 0.131423 May 23 12:52:13.031185 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 330/654] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:52:12 2022] DELETE /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 12:52:13.041510 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7a4822e2-a0ea-4422-b902-25c9b5660156 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:13.042638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7a4822e2-a0ea-4422-b902-25c9b5660156 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:13.048195 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7a4822e2-a0ea-4422-b902-25c9b5660156 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:13.048646 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7a4822e2-a0ea-4422-b902-25c9b5660156 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:13.049599 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7a4822e2-a0ea-4422-b902-25c9b5660156 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:13.050035 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7a4822e2-a0ea-4422-b902-25c9b5660156 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:13.051410 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3d5223dc-72c8-47e7-88d3-8ac7d9839c61 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:13.061665 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3d5223dc-72c8-47e7-88d3-8ac7d9839c61 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.168125 May 23 12:52:13.063598 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 325/655] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:12 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:13.185701 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7a4822e2-a0ea-4422-b902-25c9b5660156 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:13.193523 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7a4822e2-a0ea-4422-b902-25c9b5660156 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1681 microversion: 2.1 time: 0.157848 May 23 12:52:13.194093 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 331/656] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:13 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:52:14.080116 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3b785731-a978-4b68-bec0-7c2692162ed1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:14.080716 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3b785731-a978-4b68-bec0-7c2692162ed1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:14.088085 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3b785731-a978-4b68-bec0-7c2692162ed1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:14.088529 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3b785731-a978-4b68-bec0-7c2692162ed1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:14.089568 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3b785731-a978-4b68-bec0-7c2692162ed1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:14.089997 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3b785731-a978-4b68-bec0-7c2692162ed1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:14.212451 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a70ac58a-d2b2-4116-a785-d43f6bb4a996 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:14.213063 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a70ac58a-d2b2-4116-a785-d43f6bb4a996 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:14.219817 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a70ac58a-d2b2-4116-a785-d43f6bb4a996 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:14.220259 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a70ac58a-d2b2-4116-a785-d43f6bb4a996 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:14.221024 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a70ac58a-d2b2-4116-a785-d43f6bb4a996 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:14.221508 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a70ac58a-d2b2-4116-a785-d43f6bb4a996 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:14.222578 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3b785731-a978-4b68-bec0-7c2692162ed1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:14.231623 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3b785731-a978-4b68-bec0-7c2692162ed1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.155345 May 23 12:52:14.232196 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 326/657] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:14 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:14.348524 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a70ac58a-d2b2-4116-a785-d43f6bb4a996 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:14.356186 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a70ac58a-d2b2-4116-a785-d43f6bb4a996 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1681 microversion: 2.1 time: 0.148459 May 23 12:52:14.356747 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 332/658] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:14 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:52:15.248095 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5608488f-4348-4214-a8af-5e01b69c8875 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:15.248722 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5608488f-4348-4214-a8af-5e01b69c8875 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:15.255179 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5608488f-4348-4214-a8af-5e01b69c8875 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:15.255623 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5608488f-4348-4214-a8af-5e01b69c8875 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:15.256375 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5608488f-4348-4214-a8af-5e01b69c8875 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:15.256802 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5608488f-4348-4214-a8af-5e01b69c8875 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:15.373811 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2262645f-4b48-4a34-9344-b0ec5c9e2c05 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:15.374445 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2262645f-4b48-4a34-9344-b0ec5c9e2c05 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:15.381293 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2262645f-4b48-4a34-9344-b0ec5c9e2c05 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:15.381740 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2262645f-4b48-4a34-9344-b0ec5c9e2c05 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:15.383045 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2262645f-4b48-4a34-9344-b0ec5c9e2c05 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:15.383554 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2262645f-4b48-4a34-9344-b0ec5c9e2c05 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:15.443769 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2262645f-4b48-4a34-9344-b0ec5c9e2c05 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:15.451825 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2262645f-4b48-4a34-9344-b0ec5c9e2c05 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 200 len: 1614 microversion: 2.1 time: 0.081860 May 23 12:52:15.452407 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 333/659] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:15 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:52:15.464191 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5608488f-4348-4214-a8af-5e01b69c8875 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:15.472248 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5608488f-4348-4214-a8af-5e01b69c8875 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.227997 May 23 12:52:15.472907 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 327/660] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:15 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:15.548580 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-63fda7fd-7e43-4adf-859a-36b700d7cd1f req-86598143-f3c7-4bad-86b2-759ada358d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9218894f-57e2-4c73-9114-84275fabe11e", "name": "network-vif-deleted", "tag": "5a86750c-5ccd-4bf6-b618-15b9d956e2fd"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:15.558100 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-63fda7fd-7e43-4adf-859a-36b700d7cd1f req-86598143-f3c7-4bad-86b2-759ada358d80 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:15.558672 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-63fda7fd-7e43-4adf-859a-36b700d7cd1f req-86598143-f3c7-4bad-86b2-759ada358d80 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:15.572804 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-63fda7fd-7e43-4adf-859a-36b700d7cd1f req-86598143-f3c7-4bad-86b2-759ada358d80 service nova] Creating event network-vif-deleted:5a86750c-5ccd-4bf6-b618-15b9d956e2fd for instance 9218894f-57e2-4c73-9114-84275fabe11e on hv-cinder-maste May 23 12:52:15.578200 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-63fda7fd-7e43-4adf-859a-36b700d7cd1f req-86598143-f3c7-4bad-86b2-759ada358d80 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033663 May 23 12:52:15.578835 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 334/661] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:16.470126 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5ff7a8be-ec96-4bf5-b628-30dfd4820c51 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:16.470738 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5ff7a8be-ec96-4bf5-b628-30dfd4820c51 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:16.477433 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ff7a8be-ec96-4bf5-b628-30dfd4820c51 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:16.477816 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ff7a8be-ec96-4bf5-b628-30dfd4820c51 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:16.478585 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ff7a8be-ec96-4bf5-b628-30dfd4820c51 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:16.479018 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ff7a8be-ec96-4bf5-b628-30dfd4820c51 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:16.493131 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3052dd99-ddff-47db-b52c-84d2304ad557 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:16.494007 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3052dd99-ddff-47db-b52c-84d2304ad557 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:16.495828 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-5ff7a8be-ec96-4bf5-b628-30dfd4820c51 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5ff7a8be-ec96-4bf5-b628-30dfd4820c51 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e HTTP/1.1 May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:52:16.497625 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:52:16.499191 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '9218894f-57e2-4c73-9114-84275fabe11e'} May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:52:16.500023 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:52:16.501362 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:16.502667 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5ff7a8be-ec96-4bf5-b628-30dfd4820c51 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:52:16.502667 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5ff7a8be-ec96-4bf5-b628-30dfd4820c51 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 404 len: 111 microversion: 2.1 time: 0.033172 May 23 12:52:16.502667 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 328/662] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:16 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:52:16.505876 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3052dd99-ddff-47db-b52c-84d2304ad557 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:16.506419 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3052dd99-ddff-47db-b52c-84d2304ad557 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:16.507910 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3052dd99-ddff-47db-b52c-84d2304ad557 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:16.508571 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3052dd99-ddff-47db-b52c-84d2304ad557 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:16.509688 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-cae3663c-f4ed-4bad-a73d-61471b5423cb tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '.version_select at 0x7f6a375a04c0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:16.528657 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-cae3663c-f4ed-4bad-a73d-61471b5423cb tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-105782505" status: 202 len: 0 microversion: 2.1 time: 0.024032 May 23 12:52:16.529275 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 329/663] 10.222.0.45 () {58 vars in 1217 bytes} [Mon May 23 12:52:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-105782505 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 12:52:16.713571 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3052dd99-ddff-47db-b52c-84d2304ad557 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:16.721920 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3052dd99-ddff-47db-b52c-84d2304ad557 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.234352 May 23 12:52:16.722493 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 335/664] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:16 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:17.449791 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-35afe651-74e0-450f-8cc7-79f97b4df4b2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: .version_select at 0x7f6a37545700>, body: {"keypair": {"name": "tempest-keypair-997688769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxSm3ViZTrkWrAx/4skBBLvEPsDx1FAA14TVqCkKK8Ka9eVUhBrcZ7j1JJQ1xdjYDohSl/pRcrENrS2fAcXQIBHnUoS1wrK2npNM5MQxqFj1sh5sx9Z8Gkl3nxggszwIQ=="}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:17.468973 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-35afe651-74e0-450f-8cc7-79f97b4df4b2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'key_pairs'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:52:17.472697 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-35afe651-74e0-450f-8cc7-79f97b4df4b2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for user 2335faffe08d4c75ab85aa124819c513 and project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'key_pairs'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:52:17.496572 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-35afe651-74e0-450f-8cc7-79f97b4df4b2 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050717 May 23 12:52:17.497157 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 330/665] 10.222.0.45 () {60 vars in 1158 bytes} [Mon May 23 12:52:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:17.739554 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e69774e5-0e6b-4d26-9220-6a76a6b037c3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:17.740907 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e69774e5-0e6b-4d26-9220-6a76a6b037c3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:17.748490 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e69774e5-0e6b-4d26-9220-6a76a6b037c3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:17.748940 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e69774e5-0e6b-4d26-9220-6a76a6b037c3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:17.749738 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e69774e5-0e6b-4d26-9220-6a76a6b037c3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:17.750169 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e69774e5-0e6b-4d26-9220-6a76a6b037c3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:17.892187 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e69774e5-0e6b-4d26-9220-6a76a6b037c3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:17.901834 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e69774e5-0e6b-4d26-9220-6a76a6b037c3 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.166095 May 23 12:52:17.902421 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 336/666] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:17 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:18.919830 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1fa40447-98f8-4749-b9b5-458d930a565d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:18.920577 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1fa40447-98f8-4749-b9b5-458d930a565d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:18.927416 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1fa40447-98f8-4749-b9b5-458d930a565d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:18.927862 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1fa40447-98f8-4749-b9b5-458d930a565d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:18.928632 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1fa40447-98f8-4749-b9b5-458d930a565d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:18.929774 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1fa40447-98f8-4749-b9b5-458d930a565d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:19.023563 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2146480617", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6101120e-4403-4c14-bcc5-167e49bfb907"}], "security_groups": [{"name": "tempest-securitygroup--1128353387"}], "key_name": "tempest-keypair-997688769", "user_data": "}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:19.068675 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-1fa40447-98f8-4749-b9b5-458d930a565d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:19.079479 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1fa40447-98f8-4749-b9b5-458d930a565d tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.164255 May 23 12:52:19.080129 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 331/667] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:18 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:19.139860 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.network.neutron [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] validate_networks() for [('6101120e-4403-4c14-bcc5-167e49bfb907', None, None, None, None, None)] {{(pid=134546) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:52:19.504747 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Flavor limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:52:19.505199 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Image limits 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:52:19.505672 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Flavor pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:52:19.506076 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Image pref 0:0:0 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:52:19.506484 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.virt.hardware [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:52:19.515859 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:19.516244 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:19.517041 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:19.517505 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:19.533744 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:52:19.537670 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Getting quotas for user 2335faffe08d4c75ab85aa124819c513 and project 779c7b393d37486eadf1fdc94edf7e59. Resources: {'instances', 'ram', 'cores'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:52:19.548387 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Going to run 1 instances... {{(pid=134546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:52:19.550649 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:52:19.598006 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6372be6a-f8ea-4b61-986c-fd33315aef79 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.580085 May 23 12:52:19.598828 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 337/668] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:52:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:52:19.609379 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b8a9952d-d2d9-4fbf-bbd4-705decb500d6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:19.609985 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b8a9952d-d2d9-4fbf-bbd4-705decb500d6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:19.665952 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b8a9952d-d2d9-4fbf-bbd4-705decb500d6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:19.673079 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b8a9952d-d2d9-4fbf-bbd4-705decb500d6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1241 microversion: 2.1 time: 0.067626 May 23 12:52:19.673683 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 332/669] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:19 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:20.097134 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5dd82df0-8efd-4179-9db9-98a36f9bcb56 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:20.097753 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5dd82df0-8efd-4179-9db9-98a36f9bcb56 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:20.105397 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5dd82df0-8efd-4179-9db9-98a36f9bcb56 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:20.105842 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5dd82df0-8efd-4179-9db9-98a36f9bcb56 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:20.106595 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5dd82df0-8efd-4179-9db9-98a36f9bcb56 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:20.107030 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5dd82df0-8efd-4179-9db9-98a36f9bcb56 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:20.239035 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5dd82df0-8efd-4179-9db9-98a36f9bcb56 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:20.247937 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5dd82df0-8efd-4179-9db9-98a36f9bcb56 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1735 microversion: 2.1 time: 0.154997 May 23 12:52:20.248504 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 338/670] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:20 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:20.690263 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-95a25261-b02f-44ba-a702-773c49a1cb18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:20.690815 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-95a25261-b02f-44ba-a702-773c49a1cb18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:20.697687 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-95a25261-b02f-44ba-a702-773c49a1cb18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:20.698128 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-95a25261-b02f-44ba-a702-773c49a1cb18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:20.698876 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-95a25261-b02f-44ba-a702-773c49a1cb18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:20.699302 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-95a25261-b02f-44ba-a702-773c49a1cb18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:20.703902 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:20.762990 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-95a25261-b02f-44ba-a702-773c49a1cb18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:20.770416 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-95a25261-b02f-44ba-a702-773c49a1cb18 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1293 microversion: 2.1 time: 0.084065 May 23 12:52:20.770972 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 333/671] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:20 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:21.268757 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8789b1d6-a747-4c00-96a7-6a1e0fad44ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:21.269871 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8789b1d6-a747-4c00-96a7-6a1e0fad44ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:21.278173 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8789b1d6-a747-4c00-96a7-6a1e0fad44ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:21.278853 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8789b1d6-a747-4c00-96a7-6a1e0fad44ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:21.279783 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8789b1d6-a747-4c00-96a7-6a1e0fad44ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:21.280375 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8789b1d6-a747-4c00-96a7-6a1e0fad44ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:21.422905 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8789b1d6-a747-4c00-96a7-6a1e0fad44ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:21.431420 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8789b1d6-a747-4c00-96a7-6a1e0fad44ea tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1715 microversion: 2.1 time: 0.167865 May 23 12:52:21.431922 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 339/672] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:21 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:21.537592 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-626b900a-ed1e-4e89-a82f-2a9960551255 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:21.538237 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-626b900a-ed1e-4e89-a82f-2a9960551255 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:21.544352 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-626b900a-ed1e-4e89-a82f-2a9960551255 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:21.544874 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-626b900a-ed1e-4e89-a82f-2a9960551255 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:21.545734 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-626b900a-ed1e-4e89-a82f-2a9960551255 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:21.546234 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-626b900a-ed1e-4e89-a82f-2a9960551255 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:21.628163 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-626b900a-ed1e-4e89-a82f-2a9960551255 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] HTTP exception thrown: Cannot 'detach_volume' instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 while it is in vm_state rescued May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-626b900a-ed1e-4e89-a82f-2a9960551255 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Request method failure captured: May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: DELETE /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments/e60cb3a4-5dfa-4318-8753-dbaecb3e4e11 HTTP/1.1 May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4KmP_azytTUVLXNckphaPdAaLly42fx__PDc1LKD4jdw5xA3BQJA7YCs-jJSyC1EgTilp6eFPCuWOn4bgqZB6Ca_Cc8vgLBCx4axkRxczK028StFWqZENxl-CpLJ12vWGyihsxUYlg7PZ0INoaYGAHss53fwTUh_R2ok0ygOjO_MVI May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 3433fceb10214afcbc819edcec864651 May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:52:21.629704 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3433fceb10214afcbc819edcec864651"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3433fceb10214afcbc819edcec864651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3433fceb10214afcbc819edcec864651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3433fceb10214afcbc819edcec864651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 3433fceb10214afcbc819edcec864651 May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-ServerRescueNegativeTestJSON-1104474870-project May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: e90f349f384245fb8a118be176ad6829 May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1104474870-project May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:52:21.631238 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Cannot 'detach_volume' instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 while it is in vm_state rescued May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'server_id': '67a42629-21e9-4985-9f40-50fcb8ac70a5', 'id': 'e60cb3a4-5dfa-4318-8753-dbaecb3e4e11'} May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:52:21.632820 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 while it is in vm_state rescued May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 while it is in vm_state rescued May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:52:21.634654 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-626b900a-ed1e-4e89-a82f-2a9960551255 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Returning 409 to user: Cannot 'detach_volume' instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 while it is in vm_state rescued {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:52:21.635809 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-626b900a-ed1e-4e89-a82f-2a9960551255 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "DELETE /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments/e60cb3a4-5dfa-4318-8753-dbaecb3e4e11" status: 409 len: 152 microversion: 2.1 time: 0.097614 May 23 12:52:21.635809 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 334/673] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:52:21 2022] DELETE /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments/e60cb3a4-5dfa-4318-8753-dbaecb3e4e11 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 12:52:21.640816 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d7604f63-5ac4-4bd7-aea4-9888a017c4d1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:21.641431 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d7604f63-5ac4-4bd7-aea4-9888a017c4d1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:21.649187 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7604f63-5ac4-4bd7-aea4-9888a017c4d1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:21.649675 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7604f63-5ac4-4bd7-aea4-9888a017c4d1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:21.650517 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7604f63-5ac4-4bd7-aea4-9888a017c4d1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:21.650983 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d7604f63-5ac4-4bd7-aea4-9888a017c4d1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:21.717097 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d7604f63-5ac4-4bd7-aea4-9888a017c4d1 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "POST /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/action" status: 202 len: 0 microversion: 2.1 time: 0.080198 May 23 12:52:21.717834 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 340/674] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:52:21 2022] POST /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:52:21.726123 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b810bca1-28b4-411b-b4ed-e89ab794283e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:21.726856 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b810bca1-28b4-411b-b4ed-e89ab794283e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:21.734298 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b810bca1-28b4-411b-b4ed-e89ab794283e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:21.734846 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b810bca1-28b4-411b-b4ed-e89ab794283e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:21.735620 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b810bca1-28b4-411b-b4ed-e89ab794283e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:21.736110 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b810bca1-28b4-411b-b4ed-e89ab794283e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:21.789194 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e9810bb3-b67f-42f6-be03-72de4dad2249 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:21.789891 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e9810bb3-b67f-42f6-be03-72de4dad2249 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:21.796297 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9810bb3-b67f-42f6-be03-72de4dad2249 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:21.796879 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9810bb3-b67f-42f6-be03-72de4dad2249 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:21.797698 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9810bb3-b67f-42f6-be03-72de4dad2249 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:21.798137 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9810bb3-b67f-42f6-be03-72de4dad2249 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:21.913736 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e9810bb3-b67f-42f6-be03-72de4dad2249 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:21.922504 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e9810bb3-b67f-42f6-be03-72de4dad2249 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1299 microversion: 2.1 time: 0.138245 May 23 12:52:21.933238 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 341/675] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:21 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1299 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:52:21.951122 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b810bca1-28b4-411b-b4ed-e89ab794283e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:21.960296 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b810bca1-28b4-411b-b4ed-e89ab794283e tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1723 microversion: 2.1 time: 0.238147 May 23 12:52:21.960956 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 335/676] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:21 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:52:22.715474 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-5ed8adf1-c68e-46bf-9c7a-47fbd2eaa7f3 req-6f15ef78-9797-4b12-a223-36d5040b0ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3823dc6-846f-4822-a7d2-68e988324698", "tag": "1e6b5036-7672-4a70-869a-bd488450d3b5"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:22.724125 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-5ed8adf1-c68e-46bf-9c7a-47fbd2eaa7f3 req-6f15ef78-9797-4b12-a223-36d5040b0ad0 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:22.724295 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-5ed8adf1-c68e-46bf-9c7a-47fbd2eaa7f3 req-6f15ef78-9797-4b12-a223-36d5040b0ad0 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:22.743385 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-5ed8adf1-c68e-46bf-9c7a-47fbd2eaa7f3 req-6f15ef78-9797-4b12-a223-36d5040b0ad0 service nova] Creating event network-changed:1e6b5036-7672-4a70-869a-bd488450d3b5 for instance e3823dc6-846f-4822-a7d2-68e988324698 on hv-cinder-maste May 23 12:52:22.748471 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-5ed8adf1-c68e-46bf-9c7a-47fbd2eaa7f3 req-6f15ef78-9797-4b12-a223-36d5040b0ad0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037161 May 23 12:52:22.748993 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 342/677] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:52:22.939829 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5a7c79e1-596d-4d57-96de-168d1ae8b14c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:22.940452 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5a7c79e1-596d-4d57-96de-168d1ae8b14c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:22.947027 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5a7c79e1-596d-4d57-96de-168d1ae8b14c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:22.947469 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5a7c79e1-596d-4d57-96de-168d1ae8b14c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:22.948217 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5a7c79e1-596d-4d57-96de-168d1ae8b14c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:22.948644 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5a7c79e1-596d-4d57-96de-168d1ae8b14c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:22.978973 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f29c795e-e88d-4c59-ae84-11cd3a2e3171 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:22.979663 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f29c795e-e88d-4c59-ae84-11cd3a2e3171 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:22.985984 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f29c795e-e88d-4c59-ae84-11cd3a2e3171 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:22.986359 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f29c795e-e88d-4c59-ae84-11cd3a2e3171 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:22.987124 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f29c795e-e88d-4c59-ae84-11cd3a2e3171 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:22.987552 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f29c795e-e88d-4c59-ae84-11cd3a2e3171 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:23.078880 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5a7c79e1-596d-4d57-96de-168d1ae8b14c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:23.086352 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5a7c79e1-596d-4d57-96de-168d1ae8b14c tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1367 microversion: 2.1 time: 0.150399 May 23 12:52:23.086924 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 336/678] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:22 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:23.119018 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f29c795e-e88d-4c59-ae84-11cd3a2e3171 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:23.129519 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f29c795e-e88d-4c59-ae84-11cd3a2e3171 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1723 microversion: 2.1 time: 0.155298 May 23 12:52:23.130110 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 343/679] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:22 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:52:24.104401 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3ec7872d-9b8d-4a5b-8dbc-181900604b8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:24.105003 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3ec7872d-9b8d-4a5b-8dbc-181900604b8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:24.111418 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3ec7872d-9b8d-4a5b-8dbc-181900604b8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:24.111868 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3ec7872d-9b8d-4a5b-8dbc-181900604b8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:24.112634 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3ec7872d-9b8d-4a5b-8dbc-181900604b8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:24.113072 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3ec7872d-9b8d-4a5b-8dbc-181900604b8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:24.148863 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1e76a60a-7dfc-4b54-a5da-297d858bada9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:24.149586 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1e76a60a-7dfc-4b54-a5da-297d858bada9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:24.156029 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1e76a60a-7dfc-4b54-a5da-297d858bada9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:24.156475 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1e76a60a-7dfc-4b54-a5da-297d858bada9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:24.157271 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1e76a60a-7dfc-4b54-a5da-297d858bada9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:24.157710 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1e76a60a-7dfc-4b54-a5da-297d858bada9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:24.173440 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:24.249958 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3ec7872d-9b8d-4a5b-8dbc-181900604b8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:24.257803 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3ec7872d-9b8d-4a5b-8dbc-181900604b8d tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1367 microversion: 2.1 time: 0.158197 May 23 12:52:24.258398 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 337/680] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:24 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:24.290605 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1e76a60a-7dfc-4b54-a5da-297d858bada9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:24.299023 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1e76a60a-7dfc-4b54-a5da-297d858bada9 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1729 microversion: 2.1 time: 0.155122 May 23 12:52:24.299581 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 344/681] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:24 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:24.315102 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d81f9d00-7697-4e71-a047-6ff8b2d39e6a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:24.315591 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d81f9d00-7697-4e71-a047-6ff8b2d39e6a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:24.322476 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d81f9d00-7697-4e71-a047-6ff8b2d39e6a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:24.322977 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d81f9d00-7697-4e71-a047-6ff8b2d39e6a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:24.323725 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d81f9d00-7697-4e71-a047-6ff8b2d39e6a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:24.324153 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d81f9d00-7697-4e71-a047-6ff8b2d39e6a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:24.402793 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d81f9d00-7697-4e71-a047-6ff8b2d39e6a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091483 May 23 12:52:24.403391 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 338/682] 10.222.0.45 () {58 vars in 1274 bytes} [Mon May 23 12:52:24 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:25.274767 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1780ba24-0f3f-4018-8dea-43fec51aaaba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:25.275353 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1780ba24-0f3f-4018-8dea-43fec51aaaba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:25.281796 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1780ba24-0f3f-4018-8dea-43fec51aaaba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:25.282240 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1780ba24-0f3f-4018-8dea-43fec51aaaba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:25.283006 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1780ba24-0f3f-4018-8dea-43fec51aaaba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:25.283439 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1780ba24-0f3f-4018-8dea-43fec51aaaba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:25.419050 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1780ba24-0f3f-4018-8dea-43fec51aaaba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:25.426481 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1780ba24-0f3f-4018-8dea-43fec51aaaba tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1367 microversion: 2.1 time: 0.155749 May 23 12:52:25.427262 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 345/683] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:25 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:25.790533 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-f097e0ea-ac20-4849-8de2-7063dbd99470 req-9011dcc9-7747-44ae-937b-8c107924b640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a42629-21e9-4985-9f40-50fcb8ac70a5", "tag": "60f89927-1069-4785-bbc6-46be1dcf99aa"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:25.799802 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-f097e0ea-ac20-4849-8de2-7063dbd99470 req-9011dcc9-7747-44ae-937b-8c107924b640 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:25.800241 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-f097e0ea-ac20-4849-8de2-7063dbd99470 req-9011dcc9-7747-44ae-937b-8c107924b640 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:25.811460 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-f097e0ea-ac20-4849-8de2-7063dbd99470 req-9011dcc9-7747-44ae-937b-8c107924b640 service nova] Creating event network-changed:60f89927-1069-4785-bbc6-46be1dcf99aa for instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 on hv-cinder-maste May 23 12:52:25.816513 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-f097e0ea-ac20-4849-8de2-7063dbd99470 req-9011dcc9-7747-44ae-937b-8c107924b640 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030920 May 23 12:52:25.817109 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 339/684] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:52:26.443749 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a125a729-8156-46d4-94b2-cebea4733fcd tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:26.445132 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a125a729-8156-46d4-94b2-cebea4733fcd tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:26.451801 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a125a729-8156-46d4-94b2-cebea4733fcd tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:26.452241 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a125a729-8156-46d4-94b2-cebea4733fcd tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:26.453000 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a125a729-8156-46d4-94b2-cebea4733fcd tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:26.453459 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a125a729-8156-46d4-94b2-cebea4733fcd tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:26.596711 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a125a729-8156-46d4-94b2-cebea4733fcd tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:26.605212 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a125a729-8156-46d4-94b2-cebea4733fcd tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1367 microversion: 2.1 time: 0.164944 May 23 12:52:26.605806 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 346/685] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:26 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:27.623665 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6b7595da-cfeb-46cd-b2db-c1a685108665 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:27.624344 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6b7595da-cfeb-46cd-b2db-c1a685108665 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:27.630643 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6b7595da-cfeb-46cd-b2db-c1a685108665 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:27.631093 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6b7595da-cfeb-46cd-b2db-c1a685108665 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:27.632417 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6b7595da-cfeb-46cd-b2db-c1a685108665 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:27.633050 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6b7595da-cfeb-46cd-b2db-c1a685108665 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:27.766605 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6b7595da-cfeb-46cd-b2db-c1a685108665 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:27.774068 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6b7595da-cfeb-46cd-b2db-c1a685108665 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1367 microversion: 2.1 time: 0.155260 May 23 12:52:27.774641 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 340/686] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:27 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:27.831285 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-f9342590-0d2e-4a02-8502-53fbba7dc606 req-414172e9-2b14-49d2-978b-92782d00f9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a42629-21e9-4985-9f40-50fcb8ac70a5", "tag": "60f89927-1069-4785-bbc6-46be1dcf99aa"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:27.839965 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-f9342590-0d2e-4a02-8502-53fbba7dc606 req-414172e9-2b14-49d2-978b-92782d00f9fa service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:27.840398 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-f9342590-0d2e-4a02-8502-53fbba7dc606 req-414172e9-2b14-49d2-978b-92782d00f9fa service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:27.851049 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-f9342590-0d2e-4a02-8502-53fbba7dc606 req-414172e9-2b14-49d2-978b-92782d00f9fa service nova] Creating event network-changed:60f89927-1069-4785-bbc6-46be1dcf99aa for instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 on hv-cinder-maste May 23 12:52:27.855929 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-f9342590-0d2e-4a02-8502-53fbba7dc606 req-414172e9-2b14-49d2-978b-92782d00f9fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028272 May 23 12:52:27.856509 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 347/687] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:28.791477 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-78e9cdbf-95f6-4240-bd53-e3f3778d585b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:28.792117 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-78e9cdbf-95f6-4240-bd53-e3f3778d585b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:28.798532 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-78e9cdbf-95f6-4240-bd53-e3f3778d585b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:28.798982 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-78e9cdbf-95f6-4240-bd53-e3f3778d585b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:28.799742 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-78e9cdbf-95f6-4240-bd53-e3f3778d585b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:28.800176 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-78e9cdbf-95f6-4240-bd53-e3f3778d585b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:28.931772 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-78e9cdbf-95f6-4240-bd53-e3f3778d585b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:28.939090 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-78e9cdbf-95f6-4240-bd53-e3f3778d585b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1367 microversion: 2.1 time: 0.152214 May 23 12:52:28.939650 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 341/688] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:28 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:29.953530 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=2 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:29.954361 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=6 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:29.958562 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9d86263c-34f8-492e-8f58-8d309e6cf8c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:29.959245 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-9d86263c-34f8-492e-8f58-8d309e6cf8c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:29.967295 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9d86263c-34f8-492e-8f58-8d309e6cf8c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:29.967673 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9d86263c-34f8-492e-8f58-8d309e6cf8c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:29.968419 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9d86263c-34f8-492e-8f58-8d309e6cf8c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:29.968850 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9d86263c-34f8-492e-8f58-8d309e6cf8c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:30.103914 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9d86263c-34f8-492e-8f58-8d309e6cf8c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:30.111299 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-9d86263c-34f8-492e-8f58-8d309e6cf8c9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1367 microversion: 2.1 time: 0.159256 May 23 12:52:30.111866 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 348/689] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:29 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:31.126523 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-89e1adc9-b556-419b-9fc3-ffa2f46d5183 req-012d802f-adf3-49f6-a059-d75e2c3634f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3823dc6-846f-4822-a7d2-68e988324698", "name": "network-vif-plugged", "status": "completed", "tag": "1e6b5036-7672-4a70-869a-bd488450d3b5"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:31.128458 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-27d89bc3-0793-47ac-b9dc-5bb674947ca9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:31.129061 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-27d89bc3-0793-47ac-b9dc-5bb674947ca9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:31.131987 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=6 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:31.136488 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-27d89bc3-0793-47ac-b9dc-5bb674947ca9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:31.136934 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-27d89bc3-0793-47ac-b9dc-5bb674947ca9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:31.137745 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-27d89bc3-0793-47ac-b9dc-5bb674947ca9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:31.137977 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-89e1adc9-b556-419b-9fc3-ffa2f46d5183 req-012d802f-adf3-49f6-a059-d75e2c3634f0 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:31.138172 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-27d89bc3-0793-47ac-b9dc-5bb674947ca9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:31.138577 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-89e1adc9-b556-419b-9fc3-ffa2f46d5183 req-012d802f-adf3-49f6-a059-d75e2c3634f0 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:31.151889 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-89e1adc9-b556-419b-9fc3-ffa2f46d5183 req-012d802f-adf3-49f6-a059-d75e2c3634f0 service nova] Creating event network-vif-plugged:1e6b5036-7672-4a70-869a-bd488450d3b5 for instance e3823dc6-846f-4822-a7d2-68e988324698 on hv-cinder-maste May 23 12:52:31.157108 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-89e1adc9-b556-419b-9fc3-ffa2f46d5183 req-012d802f-adf3-49f6-a059-d75e2c3634f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 May 23 12:52:31.157743 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 342/690] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:31.291284 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-27d89bc3-0793-47ac-b9dc-5bb674947ca9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:31.298677 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-27d89bc3-0793-47ac-b9dc-5bb674947ca9 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1367 microversion: 2.1 time: 0.174140 May 23 12:52:31.299256 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 349/691] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:31 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:52:32.110821 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-cfa88158-2d26-43ba-8d49-82c57ba0c119 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-608902090"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:32.111436 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-cfa88158-2d26-43ba-8d49-82c57ba0c119 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:32.118342 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cfa88158-2d26-43ba-8d49-82c57ba0c119 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:32.118790 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cfa88158-2d26-43ba-8d49-82c57ba0c119 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:32.119548 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cfa88158-2d26-43ba-8d49-82c57ba0c119 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:32.119973 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cfa88158-2d26-43ba-8d49-82c57ba0c119 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:32.247479 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.network.security_group_api [None req-cfa88158-2d26-43ba-8d49-82c57ba0c119 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Removing security group ade96cce-6938-4bf8-82ae-6a75ae48cbf6 from port 840097c5-e401-4648-8ecb-639577acce99 May 23 12:52:32.315929 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f318d7c8-56b6-4dc2-ba74-9c5aef0b7ff3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:32.316537 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f318d7c8-56b6-4dc2-ba74-9c5aef0b7ff3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:32.324355 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f318d7c8-56b6-4dc2-ba74-9c5aef0b7ff3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:32.324795 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f318d7c8-56b6-4dc2-ba74-9c5aef0b7ff3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:32.325596 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f318d7c8-56b6-4dc2-ba74-9c5aef0b7ff3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:32.326022 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f318d7c8-56b6-4dc2-ba74-9c5aef0b7ff3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:32.463358 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f318d7c8-56b6-4dc2-ba74-9c5aef0b7ff3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:32.471038 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f318d7c8-56b6-4dc2-ba74-9c5aef0b7ff3 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1367 microversion: 2.1 time: 0.159077 May 23 12:52:32.471604 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 350/692] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:32 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:52:32.639757 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-cfa88158-2d26-43ba-8d49-82c57ba0c119 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "POST /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/action" status: 202 len: 0 microversion: 2.1 time: 0.533087 May 23 12:52:32.640537 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 343/693] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:52:32 2022] POST /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:52:32.659314 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-385010c4-12c1-4f31-856a-ba53e6d3ce07 req-8d7fe55b-c449-4f36-93b1-2e7c70e5f688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b00eae-ec09-4a1b-9987-9044598907c3", "tag": "840097c5-e401-4648-8ecb-639577acce99"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:32.680734 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-385010c4-12c1-4f31-856a-ba53e6d3ce07 req-8d7fe55b-c449-4f36-93b1-2e7c70e5f688 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:32.681500 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-385010c4-12c1-4f31-856a-ba53e6d3ce07 req-8d7fe55b-c449-4f36-93b1-2e7c70e5f688 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:32.698370 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-385010c4-12c1-4f31-856a-ba53e6d3ce07 req-8d7fe55b-c449-4f36-93b1-2e7c70e5f688 service nova] Creating event network-changed:840097c5-e401-4648-8ecb-639577acce99 for instance f2b00eae-ec09-4a1b-9987-9044598907c3 on hv-cinder-maste May 23 12:52:32.705742 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-385010c4-12c1-4f31-856a-ba53e6d3ce07 req-8d7fe55b-c449-4f36-93b1-2e7c70e5f688 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057086 May 23 12:52:32.706676 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 351/694] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:33.490619 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-69de005d-5289-4b4b-9d7c-4597f4d55473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:33.491340 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-69de005d-5289-4b4b-9d7c-4597f4d55473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:33.497536 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-69de005d-5289-4b4b-9d7c-4597f4d55473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:33.497986 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-69de005d-5289-4b4b-9d7c-4597f4d55473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:33.498751 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-69de005d-5289-4b4b-9d7c-4597f4d55473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:33.499182 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-69de005d-5289-4b4b-9d7c-4597f4d55473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:33.846578 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-69de005d-5289-4b4b-9d7c-4597f4d55473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:33.854325 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-69de005d-5289-4b4b-9d7c-4597f4d55473 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1558 microversion: 2.1 time: 0.369116 May 23 12:52:33.855023 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 344/695] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:33 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1558 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:33.871965 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b5719fd0-fd60-450c-85d6-1599e762bcbf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:33.872642 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b5719fd0-fd60-450c-85d6-1599e762bcbf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:33.879288 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b5719fd0-fd60-450c-85d6-1599e762bcbf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:33.879718 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b5719fd0-fd60-450c-85d6-1599e762bcbf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:33.880480 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b5719fd0-fd60-450c-85d6-1599e762bcbf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:33.880912 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b5719fd0-fd60-450c-85d6-1599e762bcbf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:33.961640 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b5719fd0-fd60-450c-85d6-1599e762bcbf tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093806 May 23 12:52:33.962319 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 352/696] 10.222.0.45 () {58 vars in 1274 bytes} [Mon May 23 12:52:33 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:34.206509 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-36f27473-a2f5-42fb-93bc-969e0f0109b3 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:34.207329 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-36f27473-a2f5-42fb-93bc-969e0f0109b3 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:34.214757 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-36f27473-a2f5-42fb-93bc-969e0f0109b3 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:34.215465 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-36f27473-a2f5-42fb-93bc-969e0f0109b3 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:34.216425 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-36f27473-a2f5-42fb-93bc-969e0f0109b3 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:34.217019 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-36f27473-a2f5-42fb-93bc-969e0f0109b3 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:34.306343 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-36f27473-a2f5-42fb-93bc-969e0f0109b3 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lazy-loading 'services' on Instance uuid f2b00eae-ec09-4a1b-9987-9044598907c3 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:52:34.395124 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-36f27473-a2f5-42fb-93bc-969e0f0109b3 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments/2f16474c-ac31-4d53-ada8-9d04a63045b5" status: 202 len: 0 microversion: 2.1 time: 0.192911 May 23 12:52:34.406481 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6ecdb861-44fa-4699-9b7f-5890730a142f tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:34.408008 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6ecdb861-44fa-4699-9b7f-5890730a142f tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:34.412332 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 345/697] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:52:34 2022] DELETE /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments/2f16474c-ac31-4d53-ada8-9d04a63045b5 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:52:34.417523 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6ecdb861-44fa-4699-9b7f-5890730a142f tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:34.418414 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6ecdb861-44fa-4699-9b7f-5890730a142f tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:34.419370 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6ecdb861-44fa-4699-9b7f-5890730a142f tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:34.420064 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6ecdb861-44fa-4699-9b7f-5890730a142f tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:34.483850 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6ecdb861-44fa-4699-9b7f-5890730a142f tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082625 May 23 12:52:34.485095 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 353/698] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:52:34 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:34.724750 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-31755e95-3275-42e7-a148-fc34fd3ff16b req-fbcde1a2-08d6-41ec-9bc5-1efa55898d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b00eae-ec09-4a1b-9987-9044598907c3", "tag": "840097c5-e401-4648-8ecb-639577acce99"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:34.735601 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-31755e95-3275-42e7-a148-fc34fd3ff16b req-fbcde1a2-08d6-41ec-9bc5-1efa55898d8d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:34.736086 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-31755e95-3275-42e7-a148-fc34fd3ff16b req-fbcde1a2-08d6-41ec-9bc5-1efa55898d8d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:34.748885 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-31755e95-3275-42e7-a148-fc34fd3ff16b req-fbcde1a2-08d6-41ec-9bc5-1efa55898d8d service nova] Creating event network-changed:840097c5-e401-4648-8ecb-639577acce99 for instance f2b00eae-ec09-4a1b-9987-9044598907c3 on hv-cinder-maste May 23 12:52:34.755721 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-31755e95-3275-42e7-a148-fc34fd3ff16b req-fbcde1a2-08d6-41ec-9bc5-1efa55898d8d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035379 May 23 12:52:34.756677 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 346/699] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:34.951935 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-eec9e296-27a7-4da2-984e-d8de841af7bf req-e092832d-2a08-4fb9-9f80-b6f9b586e32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3823dc6-846f-4822-a7d2-68e988324698", "tag": "1e6b5036-7672-4a70-869a-bd488450d3b5"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:34.962897 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-eec9e296-27a7-4da2-984e-d8de841af7bf req-e092832d-2a08-4fb9-9f80-b6f9b586e32c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:34.963686 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-eec9e296-27a7-4da2-984e-d8de841af7bf req-e092832d-2a08-4fb9-9f80-b6f9b586e32c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:34.979440 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-eec9e296-27a7-4da2-984e-d8de841af7bf req-e092832d-2a08-4fb9-9f80-b6f9b586e32c service nova] Creating event network-changed:1e6b5036-7672-4a70-869a-bd488450d3b5 for instance e3823dc6-846f-4822-a7d2-68e988324698 on hv-cinder-maste May 23 12:52:34.984231 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-eec9e296-27a7-4da2-984e-d8de841af7bf req-e092832d-2a08-4fb9-9f80-b6f9b586e32c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035907 May 23 12:52:34.984825 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 354/700] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:35.498666 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f58a6999-9fd2-47a0-ad71-24544d772ebb tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:35.500143 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f58a6999-9fd2-47a0-ad71-24544d772ebb tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:35.507991 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:35.510378 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f58a6999-9fd2-47a0-ad71-24544d772ebb tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:35.512009 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f58a6999-9fd2-47a0-ad71-24544d772ebb tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:35.514314 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f58a6999-9fd2-47a0-ad71-24544d772ebb tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:35.515247 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f58a6999-9fd2-47a0-ad71-24544d772ebb tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:35.560949 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f58a6999-9fd2-47a0-ad71-24544d772ebb tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067989 May 23 12:52:35.562253 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 347/701] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:52:35 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:52:35.573364 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-05bcf03c-6f7b-4903-9820-6a61ca26df21 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:35.574258 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-05bcf03c-6f7b-4903-9820-6a61ca26df21 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:35.581375 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-05bcf03c-6f7b-4903-9820-6a61ca26df21 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:35.582120 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-05bcf03c-6f7b-4903-9820-6a61ca26df21 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:35.583090 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-05bcf03c-6f7b-4903-9820-6a61ca26df21 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:35.583688 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-05bcf03c-6f7b-4903-9820-6a61ca26df21 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:35.669747 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-05bcf03c-6f7b-4903-9820-6a61ca26df21 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] HTTP exception thrown: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 is not attached to volume 2f16474c-ac31-4d53-ada8-9d04a63045b5 May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-05bcf03c-6f7b-4903-9820-6a61ca26df21 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Request method failure captured: May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: DELETE /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments/2f16474c-ac31-4d53-ada8-9d04a63045b5 HTTP/1.1 May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4Lwx_3okVZjA2XJqV__H0JfjPuK_U09wAMQdd_0nEhm-X1RX6iX7D7K7_RUMYC_fMMvH_gNkITS-c5rRAlAyM5CRF-xSVQ845LNJcVNBWl5JwUO-_5MZOnShJRt4mOxS-VFAUx_8LLqA-bekil5RNrdztYlYUpxYrUWiikftyspOMs May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: a0ef120b9d274ff4b3db10ea968e99d1 May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-TestMinimumBasicScenario-1498669830 May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:52:35.686932 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a0ef120b9d274ff4b3db10ea968e99d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a0ef120b9d274ff4b3db10ea968e99d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a0ef120b9d274ff4b3db10ea968e99d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a0ef120b9d274ff4b3db10ea968e99d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-TestMinimumBasicScenario-1498669830 May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: a0ef120b9d274ff4b3db10ea968e99d1 May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1498669830 May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-TestMinimumBasicScenario-1498669830-project May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 29b73578628342a6a5751a6cb6cb7a7e May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-TestMinimumBasicScenario-1498669830-project May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:52:35.688646 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 is not attached to volume 2f16474c-ac31-4d53-ada8-9d04a63045b5 May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'server_id': 'f2b00eae-ec09-4a1b-9987-9044598907c3', 'id': '2f16474c-ac31-4d53-ada8-9d04a63045b5'} May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2f16474c-ac31-4d53-ada8-9d04a63045b5. May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:52:35.689648 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 is not attached to volume 2f16474c-ac31-4d53-ada8-9d04a63045b5 May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 is not attached to volume 2f16474c-ac31-4d53-ada8-9d04a63045b5 May 23 12:52:35.691176 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:52:35.695077 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-05bcf03c-6f7b-4903-9820-6a61ca26df21 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Returning 404 to user: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 is not attached to volume 2f16474c-ac31-4d53-ada8-9d04a63045b5 {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:52:35.696285 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-05bcf03c-6f7b-4903-9820-6a61ca26df21 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments/2f16474c-ac31-4d53-ada8-9d04a63045b5" status: 404 len: 154 microversion: 2.1 time: 0.128119 May 23 12:52:35.697016 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 355/702] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:52:35 2022] DELETE /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3/os-volume_attachments/2f16474c-ac31-4d53-ada8-9d04a63045b5 => generated 154 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:52:36.890675 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-96f885ec-63ef-4ce5-b656-130fe5d25700 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:36.891200 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-96f885ec-63ef-4ce5-b656-130fe5d25700 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:36.898314 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96f885ec-63ef-4ce5-b656-130fe5d25700 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:36.898758 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96f885ec-63ef-4ce5-b656-130fe5d25700 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:36.899516 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96f885ec-63ef-4ce5-b656-130fe5d25700 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:36.899949 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96f885ec-63ef-4ce5-b656-130fe5d25700 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:36.924561 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-96f885ec-63ef-4ce5-b656-130fe5d25700 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Going to try to terminate instance {{(pid=134547) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:52:36.999033 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-96f885ec-63ef-4ce5-b656-130fe5d25700 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 204 len: 0 microversion: 2.1 time: 0.111911 May 23 12:52:36.999615 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 348/703] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:52:36 2022] DELETE /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:52:37.008276 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4c086584-835b-4a1f-b561-0c5d67972faa tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:37.008878 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4c086584-835b-4a1f-b561-0c5d67972faa tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:37.015545 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4c086584-835b-4a1f-b561-0c5d67972faa tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:37.015987 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4c086584-835b-4a1f-b561-0c5d67972faa tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:37.016736 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4c086584-835b-4a1f-b561-0c5d67972faa tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:37.017188 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4c086584-835b-4a1f-b561-0c5d67972faa tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:37.148348 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4c086584-835b-4a1f-b561-0c5d67972faa tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:37.155705 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4c086584-835b-4a1f-b561-0c5d67972faa tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1554 microversion: 2.1 time: 0.151799 May 23 12:52:37.156265 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 356/704] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:37 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:38.173556 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5ae955ee-bdb6-417b-bcc4-14b7ccf3037c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:38.174248 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5ae955ee-bdb6-417b-bcc4-14b7ccf3037c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:38.181372 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ae955ee-bdb6-417b-bcc4-14b7ccf3037c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:38.181812 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ae955ee-bdb6-417b-bcc4-14b7ccf3037c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:38.182559 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ae955ee-bdb6-417b-bcc4-14b7ccf3037c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:38.182987 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5ae955ee-bdb6-417b-bcc4-14b7ccf3037c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:38.311187 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5ae955ee-bdb6-417b-bcc4-14b7ccf3037c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:38.318558 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5ae955ee-bdb6-417b-bcc4-14b7ccf3037c tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1554 microversion: 2.1 time: 0.149259 May 23 12:52:38.319471 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 349/705] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:38 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:39.337080 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a4ef2283-bd2c-459a-9dce-793011c4c293 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:39.337782 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a4ef2283-bd2c-459a-9dce-793011c4c293 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:39.340721 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:39.346240 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a4ef2283-bd2c-459a-9dce-793011c4c293 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:39.346677 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a4ef2283-bd2c-459a-9dce-793011c4c293 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:39.347442 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a4ef2283-bd2c-459a-9dce-793011c4c293 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:39.353878 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a4ef2283-bd2c-459a-9dce-793011c4c293 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:39.423646 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a4ef2283-bd2c-459a-9dce-793011c4c293 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b73578628342a6a5751a6cb6cb7a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ef120b9d274ff4b3db10ea968e99d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:52:39.431538 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a4ef2283-bd2c-459a-9dce-793011c4c293 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 200 len: 1512 microversion: 2.1 time: 0.099296 May 23 12:52:39.431946 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 357/706] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:39 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 1512 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:52:39.442701 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-ccb73c7a-7407-480b-a369-2a124b07dcea req-0ccfd6f5-7e73-4923-9d64-88d7b08d2fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b00eae-ec09-4a1b-9987-9044598907c3", "name": "network-vif-deleted", "tag": "840097c5-e401-4648-8ecb-639577acce99"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:52:39.453714 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-ccb73c7a-7407-480b-a369-2a124b07dcea req-0ccfd6f5-7e73-4923-9d64-88d7b08d2fa2 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:39.454130 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-ccb73c7a-7407-480b-a369-2a124b07dcea req-0ccfd6f5-7e73-4923-9d64-88d7b08d2fa2 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:39.458261 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:52:39.467808 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-ccb73c7a-7407-480b-a369-2a124b07dcea req-0ccfd6f5-7e73-4923-9d64-88d7b08d2fa2 service nova] Creating event network-vif-deleted:840097c5-e401-4648-8ecb-639577acce99 for instance f2b00eae-ec09-4a1b-9987-9044598907c3 on hv-cinder-maste May 23 12:52:39.473294 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-ccb73c7a-7407-480b-a369-2a124b07dcea req-0ccfd6f5-7e73-4923-9d64-88d7b08d2fa2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034278 May 23 12:52:39.473886 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 350/707] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:52:40.447917 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-92719496-b88d-4cca-bfff-563b9b2ca7ea tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:40.448457 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-92719496-b88d-4cca-bfff-563b9b2ca7ea tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] [instance: f2b00eae-ec09-4a1b-9987-9044598907c3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:52:40.454997 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92719496-b88d-4cca-bfff-563b9b2ca7ea tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:40.455422 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92719496-b88d-4cca-bfff-563b9b2ca7ea tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:40.456184 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92719496-b88d-4cca-bfff-563b9b2ca7ea tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:52:40.456617 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-92719496-b88d-4cca-bfff-563b9b2ca7ea tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:52:40.470356 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-92719496-b88d-4cca-bfff-563b9b2ca7ea tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] HTTP exception thrown: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 could not be found. May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-92719496-b88d-4cca-bfff-563b9b2ca7ea tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Request method failure captured: May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 HTTP/1.1 May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4Lwx_3okVZjA2XJqV__H0JfjPuK_U09wAMQdd_0nEhm-X1RX6iX7D7K7_RUMYC_fMMvH_gNkITS-c5rRAlAyM5CRF-xSVQ845LNJcVNBWl5JwUO-_5MZOnShJRt4mOxS-VFAUx_8LLqA-bekil5RNrdztYlYUpxYrUWiikftyspOMs May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: a0ef120b9d274ff4b3db10ea968e99d1 May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-TestMinimumBasicScenario-1498669830 May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:52:40.471887 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a0ef120b9d274ff4b3db10ea968e99d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a0ef120b9d274ff4b3db10ea968e99d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a0ef120b9d274ff4b3db10ea968e99d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a0ef120b9d274ff4b3db10ea968e99d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-TestMinimumBasicScenario-1498669830 May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: a0ef120b9d274ff4b3db10ea968e99d1 May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1498669830 May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-TestMinimumBasicScenario-1498669830-project May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 29b73578628342a6a5751a6cb6cb7a7e May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-TestMinimumBasicScenario-1498669830-project May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 could not be found. May 23 12:52:40.473501 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'f2b00eae-ec09-4a1b-9987-9044598907c3'} May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 could not be found. May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:52:40.475703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 could not be found. May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 could not be found. May 23 12:52:40.477361 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:52:40.478693 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-92719496-b88d-4cca-bfff-563b9b2ca7ea tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Returning 404 to user: Instance f2b00eae-ec09-4a1b-9987-9044598907c3 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:52:40.478693 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-92719496-b88d-4cca-bfff-563b9b2ca7ea tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3" status: 404 len: 111 microversion: 2.1 time: 0.029427 May 23 12:52:40.478693 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 358/708] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:52:40 2022] GET /compute/v2.1/servers/f2b00eae-ec09-4a1b-9987-9044598907c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:52:40.483504 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d7af2983-905d-4edf-adc3-715fb3547491 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] Calling method '.version_select at 0x7f6a3754f3a0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:52:40.501670 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d7af2983-905d-4edf-adc3-715fb3547491 tempest-TestMinimumBasicScenario-1498669830 tempest-TestMinimumBasicScenario-1498669830-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-271766976" status: 202 len: 0 microversion: 2.1 time: 0.022642 May 23 12:52:40.502217 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 351/709] 10.222.0.45 () {58 vars in 1268 bytes} [Mon May 23 12:52:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-271766976 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:53:00.378926 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-69f51f98-69e8-4229-830d-198397000057 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:00.379466 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-69f51f98-69e8-4229-830d-198397000057 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:00.381594 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=3 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:00.382222 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=69 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:00.387748 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-69f51f98-69e8-4229-830d-198397000057 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:00.388189 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-69f51f98-69e8-4229-830d-198397000057 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:00.388943 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-69f51f98-69e8-4229-830d-198397000057 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:00.389397 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-69f51f98-69e8-4229-830d-198397000057 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:00.669714 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-69f51f98-69e8-4229-830d-198397000057 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lazy-loading 'services' on Instance uuid 67a42629-21e9-4985-9f40-50fcb8ac70a5 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:53:00.740873 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-69f51f98-69e8-4229-830d-198397000057 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "DELETE /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments/e60cb3a4-5dfa-4318-8753-dbaecb3e4e11" status: 202 len: 0 microversion: 2.1 time: 0.365595 May 23 12:53:00.741494 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 359/710] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:53:00 2022] DELETE /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments/e60cb3a4-5dfa-4318-8753-dbaecb3e4e11 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:53:00.747737 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:00.751916 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5d0f9ade-aa20-4ece-975e-62aa75a3a0ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:00.752929 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5d0f9ade-aa20-4ece-975e-62aa75a3a0ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:00.759865 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d0f9ade-aa20-4ece-975e-62aa75a3a0ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:00.760319 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d0f9ade-aa20-4ece-975e-62aa75a3a0ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:00.761111 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d0f9ade-aa20-4ece-975e-62aa75a3a0ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:00.761585 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5d0f9ade-aa20-4ece-975e-62aa75a3a0ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:00.794170 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5d0f9ade-aa20-4ece-975e-62aa75a3a0ce tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047815 May 23 12:53:00.794727 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 352/711] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:53:00 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:01.807668 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-520d4307-2999-42b6-a530-94a20440fb73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:01.808751 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-520d4307-2999-42b6-a530-94a20440fb73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:01.814996 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-520d4307-2999-42b6-a530-94a20440fb73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:01.815448 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-520d4307-2999-42b6-a530-94a20440fb73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:01.816292 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-520d4307-2999-42b6-a530-94a20440fb73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:01.816720 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-520d4307-2999-42b6-a530-94a20440fb73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:01.846836 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-520d4307-2999-42b6-a530-94a20440fb73 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044369 May 23 12:53:01.847477 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 360/712] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:53:01 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:53:01.918475 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f435088b-4c3d-438d-adf4-b785def1f21a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:01.919039 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f435088b-4c3d-438d-adf4-b785def1f21a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:01.925383 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f435088b-4c3d-438d-adf4-b785def1f21a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:01.925829 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f435088b-4c3d-438d-adf4-b785def1f21a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:01.926582 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f435088b-4c3d-438d-adf4-b785def1f21a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:01.927016 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f435088b-4c3d-438d-adf4-b785def1f21a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:01.951970 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f435088b-4c3d-438d-adf4-b785def1f21a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Going to try to terminate instance {{(pid=134547) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:53:02.028102 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f435088b-4c3d-438d-adf4-b785def1f21a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "DELETE /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 204 len: 0 microversion: 2.1 time: 0.113170 May 23 12:53:02.028873 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 353/713] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:53:01 2022] DELETE /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:53:02.037706 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9cda4e14-b0e8-4a1f-a7a0-d6eeada46123 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:02.038320 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-9cda4e14-b0e8-4a1f-a7a0-d6eeada46123 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:02.044646 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9cda4e14-b0e8-4a1f-a7a0-d6eeada46123 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:02.045126 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9cda4e14-b0e8-4a1f-a7a0-d6eeada46123 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:02.045932 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9cda4e14-b0e8-4a1f-a7a0-d6eeada46123 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:02.046358 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9cda4e14-b0e8-4a1f-a7a0-d6eeada46123 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:02.179939 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9cda4e14-b0e8-4a1f-a7a0-d6eeada46123 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:02.187304 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-9cda4e14-b0e8-4a1f-a7a0-d6eeada46123 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1689 microversion: 2.1 time: 0.154042 May 23 12:53:02.187866 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 361/714] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:02 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:53:03.204273 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b8973373-74e7-4af2-a094-004c3d1bee21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:03.204978 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b8973373-74e7-4af2-a094-004c3d1bee21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:03.212464 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8973373-74e7-4af2-a094-004c3d1bee21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:03.213201 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8973373-74e7-4af2-a094-004c3d1bee21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:03.213968 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8973373-74e7-4af2-a094-004c3d1bee21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:03.214400 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b8973373-74e7-4af2-a094-004c3d1bee21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:03.449592 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b8973373-74e7-4af2-a094-004c3d1bee21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:03.457226 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b8973373-74e7-4af2-a094-004c3d1bee21 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1689 microversion: 2.1 time: 0.257091 May 23 12:53:03.457747 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 354/715] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:03 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1689 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:04.475226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-bacea9a0-98ab-4a37-a62e-7a8fe4e8ac99 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:04.475849 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-bacea9a0-98ab-4a37-a62e-7a8fe4e8ac99 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:04.482293 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bacea9a0-98ab-4a37-a62e-7a8fe4e8ac99 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:04.482739 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bacea9a0-98ab-4a37-a62e-7a8fe4e8ac99 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:04.483501 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bacea9a0-98ab-4a37-a62e-7a8fe4e8ac99 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:04.483931 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bacea9a0-98ab-4a37-a62e-7a8fe4e8ac99 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:04.610149 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-bacea9a0-98ab-4a37-a62e-7a8fe4e8ac99 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:04.618312 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-bacea9a0-98ab-4a37-a62e-7a8fe4e8ac99 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1689 microversion: 2.1 time: 0.147684 May 23 12:53:04.618884 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 362/716] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:04 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:05.635460 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8b64009c-2f68-45c6-b4e3-c3a2288581df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:05.636064 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8b64009c-2f68-45c6-b4e3-c3a2288581df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:05.642438 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8b64009c-2f68-45c6-b4e3-c3a2288581df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:05.642881 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8b64009c-2f68-45c6-b4e3-c3a2288581df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:05.643637 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8b64009c-2f68-45c6-b4e3-c3a2288581df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:05.644064 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8b64009c-2f68-45c6-b4e3-c3a2288581df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:05.866641 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8b64009c-2f68-45c6-b4e3-c3a2288581df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:05.874096 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8b64009c-2f68-45c6-b4e3-c3a2288581df tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 200 len: 1689 microversion: 2.1 time: 0.242829 May 23 12:53:05.874651 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 355/717] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:05 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 1689 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:06.384288 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-3b300939-9ceb-4809-a71c-11e7cb9a460d req-ee2ef907-4b16-42b7-961f-ad0cc6db78a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a42629-21e9-4985-9f40-50fcb8ac70a5", "name": "network-vif-deleted", "tag": "60f89927-1069-4785-bbc6-46be1dcf99aa"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:06.399748 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-3b300939-9ceb-4809-a71c-11e7cb9a460d req-ee2ef907-4b16-42b7-961f-ad0cc6db78a3 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:06.400436 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-3b300939-9ceb-4809-a71c-11e7cb9a460d req-ee2ef907-4b16-42b7-961f-ad0cc6db78a3 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:06.414144 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-3b300939-9ceb-4809-a71c-11e7cb9a460d req-ee2ef907-4b16-42b7-961f-ad0cc6db78a3 service nova] Creating event network-vif-deleted:60f89927-1069-4785-bbc6-46be1dcf99aa for instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 on hv-cinder-maste May 23 12:53:06.419487 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-3b300939-9ceb-4809-a71c-11e7cb9a460d req-ee2ef907-4b16-42b7-961f-ad0cc6db78a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113154 May 23 12:53:06.420419 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 363/718] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:06.891800 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-bee81a09-a541-441f-80e5-1d28bb0248e4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:06.892420 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-bee81a09-a541-441f-80e5-1d28bb0248e4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 67a42629-21e9-4985-9f40-50fcb8ac70a5] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:06.899091 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bee81a09-a541-441f-80e5-1d28bb0248e4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:06.899474 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bee81a09-a541-441f-80e5-1d28bb0248e4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:06.900248 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bee81a09-a541-441f-80e5-1d28bb0248e4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:06.900724 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bee81a09-a541-441f-80e5-1d28bb0248e4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:06.914112 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-bee81a09-a541-441f-80e5-1d28bb0248e4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] HTTP exception thrown: Instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 could not be found. May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-bee81a09-a541-441f-80e5-1d28bb0248e4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Request method failure captured: May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 HTTP/1.1 May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4KmP_azytTUVLXNckphaPdAaLly42fx__PDc1LKD4jdw5xA3BQJA7YCs-jJSyC1EgTilp6eFPCuWOn4bgqZB6Ca_Cc8vgLBCx4axkRxczK028StFWqZENxl-CpLJ12vWGyihsxUYlg7PZ0INoaYGAHss53fwTUh_R2ok0ygOjO_MVI May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 3433fceb10214afcbc819edcec864651 May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:53:06.915761 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3433fceb10214afcbc819edcec864651"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3433fceb10214afcbc819edcec864651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3433fceb10214afcbc819edcec864651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3433fceb10214afcbc819edcec864651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 3433fceb10214afcbc819edcec864651 May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-ServerRescueNegativeTestJSON-1104474870-project May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: e90f349f384245fb8a118be176ad6829 May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1104474870-project May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 could not be found. May 23 12:53:06.917527 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '67a42629-21e9-4985-9f40-50fcb8ac70a5'} May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 could not be found. May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:06.918912 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 could not be found. May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 could not be found. May 23 12:53:06.920163 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:06.921960 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-bee81a09-a541-441f-80e5-1d28bb0248e4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Returning 404 to user: Instance 67a42629-21e9-4985-9f40-50fcb8ac70a5 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:06.921960 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-bee81a09-a541-441f-80e5-1d28bb0248e4 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5" status: 404 len: 111 microversion: 2.1 time: 0.029284 May 23 12:53:06.921960 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 356/719] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:06 2022] GET /compute/v2.1/servers/67a42629-21e9-4985-9f40-50fcb8ac70a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:53:06.926355 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-860d40a1-dcdc-4560-9adf-6184db329478 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '.version_select at 0x7f6a36bcd940>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:06.947722 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-860d40a1-dcdc-4560-9adf-6184db329478 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-691614033" status: 202 len: 0 microversion: 2.1 time: 0.025352 May 23 12:53:06.948313 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 364/720] 10.222.0.45 () {58 vars in 1217 bytes} [Mon May 23 12:53:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-691614033 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:53:09.225964 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e42415a3-fdaa-418d-be19-22f3d580136b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:09.226465 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e42415a3-fdaa-418d-be19-22f3d580136b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:09.232356 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e42415a3-fdaa-418d-be19-22f3d580136b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:09.232805 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e42415a3-fdaa-418d-be19-22f3d580136b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:09.233595 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e42415a3-fdaa-418d-be19-22f3d580136b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:09.234042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e42415a3-fdaa-418d-be19-22f3d580136b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:09.258341 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e42415a3-fdaa-418d-be19-22f3d580136b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/ips" status: 200 len: 152 microversion: 2.20 time: 0.143479 May 23 12:53:09.258897 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 357/721] 10.222.0.45 () {60 vars in 1288 bytes} [Mon May 23 12:53:09 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/ips => generated 152 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:53:09.834699 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-777b1215-6168-403e-b512-4e16c4529342 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:09.835302 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-777b1215-6168-403e-b512-4e16c4529342 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:09.842657 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-777b1215-6168-403e-b512-4e16c4529342 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:09.843100 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-777b1215-6168-403e-b512-4e16c4529342 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:09.843852 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-777b1215-6168-403e-b512-4e16c4529342 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:09.844302 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-777b1215-6168-403e-b512-4e16c4529342 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:09.869616 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-777b1215-6168-403e-b512-4e16c4529342 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:53:09.941261 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-777b1215-6168-403e-b512-4e16c4529342 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 204 len: 0 microversion: 2.1 time: 0.110505 May 23 12:53:09.941935 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 365/722] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:53:09 2022] DELETE /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:53:09.951497 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b6485b2f-6e64-409e-9932-ed8d489b704a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:09.952246 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b6485b2f-6e64-409e-9932-ed8d489b704a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:09.959419 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b6485b2f-6e64-409e-9932-ed8d489b704a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:09.959873 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b6485b2f-6e64-409e-9932-ed8d489b704a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:09.960630 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b6485b2f-6e64-409e-9932-ed8d489b704a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:09.961069 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b6485b2f-6e64-409e-9932-ed8d489b704a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:10.099097 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b6485b2f-6e64-409e-9932-ed8d489b704a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:10.106798 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b6485b2f-6e64-409e-9932-ed8d489b704a tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1507 microversion: 2.1 time: 0.159925 May 23 12:53:10.107397 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 358/723] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:09 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:11.043527 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-90b5fddc-92fc-4f90-93aa-135b5c2f2e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:11.044140 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-90b5fddc-92fc-4f90-93aa-135b5c2f2e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:11.050693 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90b5fddc-92fc-4f90-93aa-135b5c2f2e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:11.051134 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90b5fddc-92fc-4f90-93aa-135b5c2f2e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:11.051888 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90b5fddc-92fc-4f90-93aa-135b5c2f2e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:11.052317 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90b5fddc-92fc-4f90-93aa-135b5c2f2e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:11.076659 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-90b5fddc-92fc-4f90-93aa-135b5c2f2e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lazy-loading 'flavor' on Instance uuid f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:53:11.124481 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2b7e16a4-4586-4e70-b93f-3f4b27442823 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:11.125124 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2b7e16a4-4586-4e70-b93f-3f4b27442823 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:11.132062 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2b7e16a4-4586-4e70-b93f-3f4b27442823 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:11.132514 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2b7e16a4-4586-4e70-b93f-3f4b27442823 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:11.133507 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2b7e16a4-4586-4e70-b93f-3f4b27442823 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:11.133922 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2b7e16a4-4586-4e70-b93f-3f4b27442823 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:11.276021 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2b7e16a4-4586-4e70-b93f-3f4b27442823 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:11.283550 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2b7e16a4-4586-4e70-b93f-3f4b27442823 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1507 microversion: 2.1 time: 0.163072 May 23 12:53:11.284200 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 359/724] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:11 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:53:11.336904 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-90b5fddc-92fc-4f90-93aa-135b5c2f2e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "POST /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/action" status: 202 len: 0 microversion: 2.20 time: 0.296940 May 23 12:53:11.338632 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 366/725] 10.222.0.45 () {62 vars in 1318 bytes} [Mon May 23 12:53:11 2022] POST /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 12:53:11.346117 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7621ea64-3b42-41e4-96f3-0d26ef1e2d28 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:11.346719 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7621ea64-3b42-41e4-96f3-0d26ef1e2d28 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:11.353590 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7621ea64-3b42-41e4-96f3-0d26ef1e2d28 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:11.354042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7621ea64-3b42-41e4-96f3-0d26ef1e2d28 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:11.354800 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7621ea64-3b42-41e4-96f3-0d26ef1e2d28 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:11.355258 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7621ea64-3b42-41e4-96f3-0d26ef1e2d28 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:11.483929 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7621ea64-3b42-41e4-96f3-0d26ef1e2d28 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:11.491786 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7621ea64-3b42-41e4-96f3-0d26ef1e2d28 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:11.493320 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7621ea64-3b42-41e4-96f3-0d26ef1e2d28 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:11.494474 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7621ea64-3b42-41e4-96f3-0d26ef1e2d28 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.152275 May 23 12:53:11.495034 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 360/726] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:11 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:12.302880 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8c59e03b-df29-44ac-82e5-b364b8c69b74 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:12.303653 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8c59e03b-df29-44ac-82e5-b364b8c69b74 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:12.310041 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c59e03b-df29-44ac-82e5-b364b8c69b74 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:12.310488 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c59e03b-df29-44ac-82e5-b364b8c69b74 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:12.311253 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c59e03b-df29-44ac-82e5-b364b8c69b74 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:12.311690 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c59e03b-df29-44ac-82e5-b364b8c69b74 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:12.446009 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8c59e03b-df29-44ac-82e5-b364b8c69b74 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:12.453349 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8c59e03b-df29-44ac-82e5-b364b8c69b74 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 200 len: 1507 microversion: 2.1 time: 0.155354 May 23 12:53:12.453908 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 367/727] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:12 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:12.512017 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-425bc984-0f4e-41a2-aa9c-8ed1a8db3fd8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:12.512612 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-425bc984-0f4e-41a2-aa9c-8ed1a8db3fd8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:12.519075 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-425bc984-0f4e-41a2-aa9c-8ed1a8db3fd8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:12.519508 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-425bc984-0f4e-41a2-aa9c-8ed1a8db3fd8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:12.520290 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-425bc984-0f4e-41a2-aa9c-8ed1a8db3fd8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:12.520725 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-425bc984-0f4e-41a2-aa9c-8ed1a8db3fd8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:12.685071 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-56cf9b19-25ea-4e0c-8038-e2823484527f req-7cda8fa5-2393-483c-812d-78f7a9209592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a51cec-6c49-4f03-bd8a-f6bcd0e26f79", "name": "network-vif-deleted", "tag": "4a10c41a-72fd-465c-aa34-9ebd19cc9243"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:12.697553 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-56cf9b19-25ea-4e0c-8038-e2823484527f req-7cda8fa5-2393-483c-812d-78f7a9209592 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:12.698531 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-56cf9b19-25ea-4e0c-8038-e2823484527f req-7cda8fa5-2393-483c-812d-78f7a9209592 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:12.713659 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-56cf9b19-25ea-4e0c-8038-e2823484527f req-7cda8fa5-2393-483c-812d-78f7a9209592 service nova] Creating event network-vif-deleted:4a10c41a-72fd-465c-aa34-9ebd19cc9243 for instance 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 on hv-cinder-maste May 23 12:53:12.718743 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-56cf9b19-25ea-4e0c-8038-e2823484527f req-7cda8fa5-2393-483c-812d-78f7a9209592 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039351 May 23 12:53:12.719357 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 368/728] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:12.722475 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-425bc984-0f4e-41a2-aa9c-8ed1a8db3fd8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:12.731712 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-425bc984-0f4e-41a2-aa9c-8ed1a8db3fd8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:12.733562 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-425bc984-0f4e-41a2-aa9c-8ed1a8db3fd8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:12.735010 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-425bc984-0f4e-41a2-aa9c-8ed1a8db3fd8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.227123 May 23 12:53:12.735634 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 361/729] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:12 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:13.031492 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-caf43a38-aa0e-4277-8d8d-5f2bbafccf35 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:13.032076 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-caf43a38-aa0e-4277-8d8d-5f2bbafccf35 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:13.039712 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-caf43a38-aa0e-4277-8d8d-5f2bbafccf35 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:13.040161 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-caf43a38-aa0e-4277-8d8d-5f2bbafccf35 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:13.041111 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-caf43a38-aa0e-4277-8d8d-5f2bbafccf35 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:13.041614 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-caf43a38-aa0e-4277-8d8d-5f2bbafccf35 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:13.067000 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-caf43a38-aa0e-4277-8d8d-5f2bbafccf35 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/ips" status: 200 len: 151 microversion: 2.1 time: 0.145838 May 23 12:53:13.067869 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 369/730] 10.222.0.45 () {58 vars in 1247 bytes} [Mon May 23 12:53:12 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/ips => generated 151 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:13.471047 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2c6c095d-6046-4e40-958f-caf05d3e40bc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:13.471661 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2c6c095d-6046-4e40-958f-caf05d3e40bc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:13.478148 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c6c095d-6046-4e40-958f-caf05d3e40bc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:13.478629 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c6c095d-6046-4e40-958f-caf05d3e40bc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:13.479424 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c6c095d-6046-4e40-958f-caf05d3e40bc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:13.479859 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c6c095d-6046-4e40-958f-caf05d3e40bc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:13.495547 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-2c6c095d-6046-4e40-958f-caf05d3e40bc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] HTTP exception thrown: Instance 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 could not be found. May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2c6c095d-6046-4e40-958f-caf05d3e40bc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Request method failure captured: May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 HTTP/1.1 May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4KmP_azytTUVLXNckphaPdAaLly42fx__PDc1LKD4jdw5xA3BQJA7YCs-jJSyC1EgTilp6eFPCuWOn4bgqZB6Ca_Cc8vgLBCx4axkRxczK028StFWqZENxl-CpLJ12vWGyihsxUYlg7PZ0INoaYGAHss53fwTUh_R2ok0ygOjO_MVI May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 3433fceb10214afcbc819edcec864651 May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:53:13.497068 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3433fceb10214afcbc819edcec864651"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3433fceb10214afcbc819edcec864651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3433fceb10214afcbc819edcec864651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3433fceb10214afcbc819edcec864651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 3433fceb10214afcbc819edcec864651 May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-ServerRescueNegativeTestJSON-1104474870-project May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: e90f349f384245fb8a118be176ad6829 May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1104474870-project May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 could not be found. May 23 12:53:13.498745 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '29a51cec-6c49-4f03-bd8a-f6bcd0e26f79'} May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 could not be found. May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:13.499652 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 could not be found. May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 could not be found. May 23 12:53:13.501130 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:13.502626 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2c6c095d-6046-4e40-958f-caf05d3e40bc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Returning 404 to user: Instance 29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:13.502626 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2c6c095d-6046-4e40-958f-caf05d3e40bc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79" status: 404 len: 111 microversion: 2.1 time: 0.031364 May 23 12:53:13.502626 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 362/731] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:13 2022] GET /compute/v2.1/servers/29a51cec-6c49-4f03-bd8a-f6bcd0e26f79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:53:13.508981 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1e8db9ad-f791-44ae-9eb4-36eab86f2cfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:13.509806 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1e8db9ad-f791-44ae-9eb4-36eab86f2cfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:13.516143 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1e8db9ad-f791-44ae-9eb4-36eab86f2cfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:13.516587 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1e8db9ad-f791-44ae-9eb4-36eab86f2cfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:13.517387 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1e8db9ad-f791-44ae-9eb4-36eab86f2cfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:13.517803 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1e8db9ad-f791-44ae-9eb4-36eab86f2cfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:13.547451 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1e8db9ad-f791-44ae-9eb4-36eab86f2cfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:53:13.623024 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1e8db9ad-f791-44ae-9eb4-36eab86f2cfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "DELETE /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 204 len: 0 microversion: 2.1 time: 0.119210 May 23 12:53:13.623606 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 370/732] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:53:13 2022] DELETE /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:53:13.631704 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-96fed146-bb91-4024-9e16-4ba934878961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:13.632317 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-96fed146-bb91-4024-9e16-4ba934878961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:13.639216 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96fed146-bb91-4024-9e16-4ba934878961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:13.639667 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96fed146-bb91-4024-9e16-4ba934878961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:13.640438 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96fed146-bb91-4024-9e16-4ba934878961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:13.640874 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96fed146-bb91-4024-9e16-4ba934878961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:13.753918 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9588c263-d935-4ddc-9d58-a7ce708b5be1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:13.754609 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-9588c263-d935-4ddc-9d58-a7ce708b5be1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:13.760517 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9588c263-d935-4ddc-9d58-a7ce708b5be1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:13.760959 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9588c263-d935-4ddc-9d58-a7ce708b5be1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:13.761757 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9588c263-d935-4ddc-9d58-a7ce708b5be1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:13.762183 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9588c263-d935-4ddc-9d58-a7ce708b5be1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:13.773303 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-96fed146-bb91-4024-9e16-4ba934878961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:13.780805 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-96fed146-bb91-4024-9e16-4ba934878961 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.152977 May 23 12:53:13.781405 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 363/733] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:13 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:13.895180 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9588c263-d935-4ddc-9d58-a7ce708b5be1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:13.903252 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9588c263-d935-4ddc-9d58-a7ce708b5be1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:13.904756 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9588c263-d935-4ddc-9d58-a7ce708b5be1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:13.905941 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-9588c263-d935-4ddc-9d58-a7ce708b5be1 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.156278 May 23 12:53:13.906498 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 371/734] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:13 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:53:14.388631 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-88ed97ce-03a9-4aa1-8c2d-2092a9c82bc1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7dae59c-2d57-4739-8273-fac5d1cd986b"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:14.389769 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-88ed97ce-03a9-4aa1-8c2d-2092a9c82bc1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:14.395648 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-88ed97ce-03a9-4aa1-8c2d-2092a9c82bc1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:14.396086 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-88ed97ce-03a9-4aa1-8c2d-2092a9c82bc1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:14.396877 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-88ed97ce-03a9-4aa1-8c2d-2092a9c82bc1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:14.397300 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-88ed97ce-03a9-4aa1-8c2d-2092a9c82bc1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:14.798265 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4699c980-9357-4251-b095-14add4171dfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:14.798867 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4699c980-9357-4251-b095-14add4171dfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:14.807062 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4699c980-9357-4251-b095-14add4171dfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:14.807500 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4699c980-9357-4251-b095-14add4171dfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:14.808249 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4699c980-9357-4251-b095-14add4171dfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:14.808671 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4699c980-9357-4251-b095-14add4171dfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:14.812713 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:14.940494 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4699c980-9357-4251-b095-14add4171dfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:14.948109 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4699c980-9357-4251-b095-14add4171dfc tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.153670 May 23 12:53:14.948674 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 372/735] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:14 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:53:14.953046 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-fb0de855-6a19-444a-9625-4c85ecd3b580 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:14.953674 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-fb0de855-6a19-444a-9625-4c85ecd3b580 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:14.959162 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fb0de855-6a19-444a-9625-4c85ecd3b580 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:14.959602 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fb0de855-6a19-444a-9625-4c85ecd3b580 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:14.960357 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fb0de855-6a19-444a-9625-4c85ecd3b580 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:14.960790 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fb0de855-6a19-444a-9625-4c85ecd3b580 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:15.089689 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fb0de855-6a19-444a-9625-4c85ecd3b580 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:15.097527 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fb0de855-6a19-444a-9625-4c85ecd3b580 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:15.098996 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fb0de855-6a19-444a-9625-4c85ecd3b580 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:15.100134 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-fb0de855-6a19-444a-9625-4c85ecd3b580 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.150523 May 23 12:53:15.100685 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 373/736] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:14 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:15.965177 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2f14a512-e7cc-431e-b2f5-b2815154d9f5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:15.965903 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2f14a512-e7cc-431e-b2f5-b2815154d9f5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:15.972190 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2f14a512-e7cc-431e-b2f5-b2815154d9f5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:15.972632 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2f14a512-e7cc-431e-b2f5-b2815154d9f5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:15.973414 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2f14a512-e7cc-431e-b2f5-b2815154d9f5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:15.973844 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2f14a512-e7cc-431e-b2f5-b2815154d9f5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:16.101108 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2f14a512-e7cc-431e-b2f5-b2815154d9f5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:16.109081 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2f14a512-e7cc-431e-b2f5-b2815154d9f5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1521 microversion: 2.1 time: 0.148094 May 23 12:53:16.109662 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 374/737] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:15 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:53:16.119067 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-21812bca-7f81-43fa-a491-092e6693f35b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:16.119688 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-21812bca-7f81-43fa-a491-092e6693f35b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:16.125430 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-21812bca-7f81-43fa-a491-092e6693f35b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:16.125872 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-21812bca-7f81-43fa-a491-092e6693f35b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:16.126625 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-21812bca-7f81-43fa-a491-092e6693f35b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:16.127058 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-21812bca-7f81-43fa-a491-092e6693f35b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:16.254816 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-21812bca-7f81-43fa-a491-092e6693f35b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:16.262748 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-21812bca-7f81-43fa-a491-092e6693f35b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:16.264229 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-21812bca-7f81-43fa-a491-092e6693f35b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:16.265431 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-21812bca-7f81-43fa-a491-092e6693f35b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.150537 May 23 12:53:16.265990 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 375/738] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:16 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:53:16.463438 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-88ed97ce-03a9-4aa1-8c2d-2092a9c82bc1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "POST /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.078569 May 23 12:53:16.464042 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 364/739] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:53:14 2022] POST /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/os-volume_attachments => generated 194 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:17.058704 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-79d8f6f2-115b-4ebf-9f95-caebd9d1f3d8 req-d40d0aea-ef2b-44fb-a1d6-856c5e60fedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73837a44-cd22-4db0-a18c-ecd5f3ec8156", "name": "network-vif-deleted", "tag": "a72b2e37-3743-49cb-8581-59f03ab19b54"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:17.067027 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-79d8f6f2-115b-4ebf-9f95-caebd9d1f3d8 req-d40d0aea-ef2b-44fb-a1d6-856c5e60fedd service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:17.067472 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-79d8f6f2-115b-4ebf-9f95-caebd9d1f3d8 req-d40d0aea-ef2b-44fb-a1d6-856c5e60fedd service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:17.079544 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-79d8f6f2-115b-4ebf-9f95-caebd9d1f3d8 req-d40d0aea-ef2b-44fb-a1d6-856c5e60fedd service nova] Creating event network-vif-deleted:a72b2e37-3743-49cb-8581-59f03ab19b54 for instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 on hv-cinder-maste May 23 12:53:17.084170 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-79d8f6f2-115b-4ebf-9f95-caebd9d1f3d8 req-d40d0aea-ef2b-44fb-a1d6-856c5e60fedd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 May 23 12:53:17.084762 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 376/740] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:17.126680 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a0cb66b7-0bff-4b9f-b8ca-341315b0771f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:17.127380 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a0cb66b7-0bff-4b9f-b8ca-341315b0771f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:17.133981 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0cb66b7-0bff-4b9f-b8ca-341315b0771f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:17.134483 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0cb66b7-0bff-4b9f-b8ca-341315b0771f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:17.135196 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0cb66b7-0bff-4b9f-b8ca-341315b0771f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:17.135636 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0cb66b7-0bff-4b9f-b8ca-341315b0771f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:17.207022 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a0cb66b7-0bff-4b9f-b8ca-341315b0771f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90f349f384245fb8a118be176ad6829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3433fceb10214afcbc819edcec864651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:17.215952 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a0cb66b7-0bff-4b9f-b8ca-341315b0771f tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 200 len: 1306 microversion: 2.1 time: 0.093848 May 23 12:53:17.216872 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 365/741] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:17 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 1306 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:17.284216 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8d9ff452-ad13-425c-b3db-2409e5d340cb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:17.284833 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8d9ff452-ad13-425c-b3db-2409e5d340cb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:17.291908 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8d9ff452-ad13-425c-b3db-2409e5d340cb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:17.292346 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8d9ff452-ad13-425c-b3db-2409e5d340cb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:17.293088 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8d9ff452-ad13-425c-b3db-2409e5d340cb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:17.293570 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8d9ff452-ad13-425c-b3db-2409e5d340cb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:17.450869 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8d9ff452-ad13-425c-b3db-2409e5d340cb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:17.459802 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8d9ff452-ad13-425c-b3db-2409e5d340cb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:17.462222 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8d9ff452-ad13-425c-b3db-2409e5d340cb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:17.464129 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8d9ff452-ad13-425c-b3db-2409e5d340cb tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.184203 May 23 12:53:17.464856 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 377/742] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:17 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:17.744118 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-88c79f21-2406-4c43-a503-e942131945b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:17.744684 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-88c79f21-2406-4c43-a503-e942131945b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:17.750954 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-88c79f21-2406-4c43-a503-e942131945b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:17.751406 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-88c79f21-2406-4c43-a503-e942131945b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:17.752172 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-88c79f21-2406-4c43-a503-e942131945b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:17.752603 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-88c79f21-2406-4c43-a503-e942131945b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:17.835901 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-88c79f21-2406-4c43-a503-e942131945b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lazy-loading 'services' on Instance uuid e3823dc6-846f-4822-a7d2-68e988324698 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:53:17.839508 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:17.908681 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-88c79f21-2406-4c43-a503-e942131945b8 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/os-volume_attachments/c7dae59c-2d57-4739-8273-fac5d1cd986b" status: 202 len: 0 microversion: 2.1 time: 0.168957 May 23 12:53:17.909278 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 366/743] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:53:17 2022] DELETE /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/os-volume_attachments/c7dae59c-2d57-4739-8273-fac5d1cd986b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:53:17.918765 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ec5edbb8-3dfb-4cc7-bcd0-89193b0da2d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:17.919725 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ec5edbb8-3dfb-4cc7-bcd0-89193b0da2d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:17.925897 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ec5edbb8-3dfb-4cc7-bcd0-89193b0da2d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:17.926347 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ec5edbb8-3dfb-4cc7-bcd0-89193b0da2d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:17.927111 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ec5edbb8-3dfb-4cc7-bcd0-89193b0da2d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:17.927552 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ec5edbb8-3dfb-4cc7-bcd0-89193b0da2d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:17.957072 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ec5edbb8-3dfb-4cc7-bcd0-89193b0da2d1 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043465 May 23 12:53:17.957686 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 378/744] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:53:17 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:18.234825 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-930f833d-48f4-4da9-a45d-a463850da2d5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:18.235507 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-930f833d-48f4-4da9-a45d-a463850da2d5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] [instance: 73837a44-cd22-4db0-a18c-ecd5f3ec8156] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:18.241644 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-930f833d-48f4-4da9-a45d-a463850da2d5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:18.242129 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-930f833d-48f4-4da9-a45d-a463850da2d5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:18.243789 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-930f833d-48f4-4da9-a45d-a463850da2d5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:18.244224 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-930f833d-48f4-4da9-a45d-a463850da2d5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:18.258496 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-930f833d-48f4-4da9-a45d-a463850da2d5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] HTTP exception thrown: Instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 could not be found. May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-930f833d-48f4-4da9-a45d-a463850da2d5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Request method failure captured: May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 HTTP/1.1 May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4KmP_azytTUVLXNckphaPdAaLly42fx__PDc1LKD4jdw5xA3BQJA7YCs-jJSyC1EgTilp6eFPCuWOn4bgqZB6Ca_Cc8vgLBCx4axkRxczK028StFWqZENxl-CpLJ12vWGyihsxUYlg7PZ0INoaYGAHss53fwTUh_R2ok0ygOjO_MVI May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 3433fceb10214afcbc819edcec864651 May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:53:18.260125 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3433fceb10214afcbc819edcec864651"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3433fceb10214afcbc819edcec864651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3433fceb10214afcbc819edcec864651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3433fceb10214afcbc819edcec864651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 3433fceb10214afcbc819edcec864651 May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1104474870 May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-ServerRescueNegativeTestJSON-1104474870-project May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: e90f349f384245fb8a118be176ad6829 May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1104474870-project May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 could not be found. May 23 12:53:18.261680 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '73837a44-cd22-4db0-a18c-ecd5f3ec8156'} May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 could not be found. May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:18.262390 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 could not be found. May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 could not be found. May 23 12:53:18.263973 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:18.265927 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-930f833d-48f4-4da9-a45d-a463850da2d5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] Returning 404 to user: Instance 73837a44-cd22-4db0-a18c-ecd5f3ec8156 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:18.265927 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-930f833d-48f4-4da9-a45d-a463850da2d5 tempest-ServerRescueNegativeTestJSON-1104474870 tempest-ServerRescueNegativeTestJSON-1104474870-project] 10.222.0.45 "GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156" status: 404 len: 111 microversion: 2.1 time: 0.031549 May 23 12:53:18.265927 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 367/745] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:18 2022] GET /compute/v2.1/servers/73837a44-cd22-4db0-a18c-ecd5f3ec8156 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:53:18.482463 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d1317735-3caf-4568-85dd-972041b36c70 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:18.483084 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d1317735-3caf-4568-85dd-972041b36c70 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:18.489695 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d1317735-3caf-4568-85dd-972041b36c70 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:18.490213 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d1317735-3caf-4568-85dd-972041b36c70 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:18.491039 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d1317735-3caf-4568-85dd-972041b36c70 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:18.491562 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d1317735-3caf-4568-85dd-972041b36c70 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:18.761983 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d1317735-3caf-4568-85dd-972041b36c70 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:18.769815 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d1317735-3caf-4568-85dd-972041b36c70 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:18.771423 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d1317735-3caf-4568-85dd-972041b36c70 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:18.772608 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d1317735-3caf-4568-85dd-972041b36c70 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.294114 May 23 12:53:18.773184 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 379/746] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:18 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:18.969509 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-12705631-aae7-42d9-b4e1-82c155f6afdb tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:18.971123 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-12705631-aae7-42d9-b4e1-82c155f6afdb tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:18.978169 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-12705631-aae7-42d9-b4e1-82c155f6afdb tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:18.978811 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-12705631-aae7-42d9-b4e1-82c155f6afdb tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:18.979584 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-12705631-aae7-42d9-b4e1-82c155f6afdb tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:18.980016 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-12705631-aae7-42d9-b4e1-82c155f6afdb tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:19.011529 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-12705631-aae7-42d9-b4e1-82c155f6afdb tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046025 May 23 12:53:19.012071 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 368/747] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:53:18 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:53:19.071324 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c1b853ca-8a73-4129-af10-d8743f3e3146 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:19.071828 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c1b853ca-8a73-4129-af10-d8743f3e3146 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:19.077974 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c1b853ca-8a73-4129-af10-d8743f3e3146 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:19.078431 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c1b853ca-8a73-4129-af10-d8743f3e3146 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:19.079193 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c1b853ca-8a73-4129-af10-d8743f3e3146 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:19.079621 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c1b853ca-8a73-4129-af10-d8743f3e3146 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:19.104516 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c1b853ca-8a73-4129-af10-d8743f3e3146 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:53:19.182230 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c1b853ca-8a73-4129-af10-d8743f3e3146 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 204 len: 0 microversion: 2.1 time: 0.114547 May 23 12:53:19.185180 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 380/748] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:53:19 2022] DELETE /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:53:19.191063 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-26321a23-3c10-4fba-9d9b-3fe06626ae50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:19.191826 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-26321a23-3c10-4fba-9d9b-3fe06626ae50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:19.197866 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-26321a23-3c10-4fba-9d9b-3fe06626ae50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:19.198311 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-26321a23-3c10-4fba-9d9b-3fe06626ae50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:19.199065 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-26321a23-3c10-4fba-9d9b-3fe06626ae50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:19.199623 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-26321a23-3c10-4fba-9d9b-3fe06626ae50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:19.343895 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-26321a23-3c10-4fba-9d9b-3fe06626ae50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:19.356365 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-26321a23-3c10-4fba-9d9b-3fe06626ae50 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1683 microversion: 2.1 time: 0.169077 May 23 12:53:19.356946 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 369/749] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:19 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:19.793426 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1c42b195-a296-4c9c-8701-2998c61ce253 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:19.794155 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-1c42b195-a296-4c9c-8701-2998c61ce253 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:19.800926 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1c42b195-a296-4c9c-8701-2998c61ce253 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:19.801491 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1c42b195-a296-4c9c-8701-2998c61ce253 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:19.802258 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1c42b195-a296-4c9c-8701-2998c61ce253 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:19.802687 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-1c42b195-a296-4c9c-8701-2998c61ce253 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:20.003302 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1c42b195-a296-4c9c-8701-2998c61ce253 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:20.011156 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1c42b195-a296-4c9c-8701-2998c61ce253 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:20.012651 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-1c42b195-a296-4c9c-8701-2998c61ce253 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:20.013836 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1c42b195-a296-4c9c-8701-2998c61ce253 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.225963 May 23 12:53:20.014397 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 381/750] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:19 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:20.374504 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b4a2cc49-e891-4a76-b8d1-5fd225def4da tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:20.375389 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b4a2cc49-e891-4a76-b8d1-5fd225def4da tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:20.382069 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b4a2cc49-e891-4a76-b8d1-5fd225def4da tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:20.382663 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b4a2cc49-e891-4a76-b8d1-5fd225def4da tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:20.383584 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b4a2cc49-e891-4a76-b8d1-5fd225def4da tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:20.384122 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b4a2cc49-e891-4a76-b8d1-5fd225def4da tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:20.536702 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-b4a2cc49-e891-4a76-b8d1-5fd225def4da tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:20.545338 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b4a2cc49-e891-4a76-b8d1-5fd225def4da tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1683 microversion: 2.1 time: 0.175128 May 23 12:53:20.545917 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 370/751] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:20 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:21.043064 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-64ecc5c8-6fa9-4024-b6ac-bcfbe5a99ac8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:21.044526 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-64ecc5c8-6fa9-4024-b6ac-bcfbe5a99ac8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:21.051648 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-64ecc5c8-6fa9-4024-b6ac-bcfbe5a99ac8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:21.052389 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-64ecc5c8-6fa9-4024-b6ac-bcfbe5a99ac8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:21.053380 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-64ecc5c8-6fa9-4024-b6ac-bcfbe5a99ac8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:21.053963 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-64ecc5c8-6fa9-4024-b6ac-bcfbe5a99ac8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:21.312932 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-64ecc5c8-6fa9-4024-b6ac-bcfbe5a99ac8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:21.323252 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-64ecc5c8-6fa9-4024-b6ac-bcfbe5a99ac8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:21.325085 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-64ecc5c8-6fa9-4024-b6ac-bcfbe5a99ac8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:21.327023 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-64ecc5c8-6fa9-4024-b6ac-bcfbe5a99ac8 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.299076 May 23 12:53:21.340226 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 382/752] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:21 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:21.563144 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-afc8a053-1c17-43e6-81ed-016f9686f1b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:21.564742 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-afc8a053-1c17-43e6-81ed-016f9686f1b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:21.576630 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-afc8a053-1c17-43e6-81ed-016f9686f1b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:21.577081 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-afc8a053-1c17-43e6-81ed-016f9686f1b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:21.577882 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-afc8a053-1c17-43e6-81ed-016f9686f1b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:21.578310 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-afc8a053-1c17-43e6-81ed-016f9686f1b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:21.744639 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-d313b495-0b8c-4603-b2b4-d76a29d79629 req-9a8d2a8c-583f-4439-9de4-f074976f3e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3823dc6-846f-4822-a7d2-68e988324698", "name": "network-vif-deleted", "tag": "1e6b5036-7672-4a70-869a-bd488450d3b5"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:21.761998 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-d313b495-0b8c-4603-b2b4-d76a29d79629 req-9a8d2a8c-583f-4439-9de4-f074976f3e7a service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:21.763219 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-d313b495-0b8c-4603-b2b4-d76a29d79629 req-9a8d2a8c-583f-4439-9de4-f074976f3e7a service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:21.793466 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-d313b495-0b8c-4603-b2b4-d76a29d79629 req-9a8d2a8c-583f-4439-9de4-f074976f3e7a service nova] Creating event network-vif-deleted:1e6b5036-7672-4a70-869a-bd488450d3b5 for instance e3823dc6-846f-4822-a7d2-68e988324698 on hv-cinder-maste May 23 12:53:21.800837 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-afc8a053-1c17-43e6-81ed-016f9686f1b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335faffe08d4c75ab85aa124819c513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779c7b393d37486eadf1fdc94edf7e59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:21.812590 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-afc8a053-1c17-43e6-81ed-016f9686f1b6 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 200 len: 1615 microversion: 2.1 time: 0.253198 May 23 12:53:21.826058 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-d313b495-0b8c-4603-b2b4-d76a29d79629 req-9a8d2a8c-583f-4439-9de4-f074976f3e7a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086076 May 23 12:53:21.826600 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 371/753] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:21 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 1615 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:21.833195 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 383/754] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:22.348906 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-803b95e6-a203-4811-8847-f775116b7c0c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:22.349836 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-803b95e6-a203-4811-8847-f775116b7c0c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:22.374186 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-803b95e6-a203-4811-8847-f775116b7c0c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:22.374730 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-803b95e6-a203-4811-8847-f775116b7c0c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:22.375569 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-803b95e6-a203-4811-8847-f775116b7c0c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:22.376086 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-803b95e6-a203-4811-8847-f775116b7c0c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:22.524065 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-803b95e6-a203-4811-8847-f775116b7c0c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:22.532763 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-803b95e6-a203-4811-8847-f775116b7c0c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:22.534398 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-803b95e6-a203-4811-8847-f775116b7c0c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:22.535690 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-803b95e6-a203-4811-8847-f775116b7c0c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.192852 May 23 12:53:22.536342 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 372/755] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:22 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:22.833415 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4466ec5d-5569-4642-9bfe-dc7339f0b3de tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:22.834332 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4466ec5d-5569-4642-9bfe-dc7339f0b3de tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:22.842511 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4466ec5d-5569-4642-9bfe-dc7339f0b3de tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:22.843052 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4466ec5d-5569-4642-9bfe-dc7339f0b3de tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:22.843922 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4466ec5d-5569-4642-9bfe-dc7339f0b3de tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:22.844573 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4466ec5d-5569-4642-9bfe-dc7339f0b3de tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:22.860065 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-4466ec5d-5569-4642-9bfe-dc7339f0b3de tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4466ec5d-5569-4642-9bfe-dc7339f0b3de tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 HTTP/1.1 May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:53:22.861811 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:22.863394 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'e3823dc6-846f-4822-a7d2-68e988324698'} May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:22.864283 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:22.865492 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:22.866537 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4466ec5d-5569-4642-9bfe-dc7339f0b3de tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:22.866537 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4466ec5d-5569-4642-9bfe-dc7339f0b3de tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 404 len: 111 microversion: 2.1 time: 0.035129 May 23 12:53:22.866537 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 384/756] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:22 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:53:22.872754 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-4b1323ca-07e4-43b3-b6de-b97f55f2e551 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '.version_select at 0x7f6a3755ee50>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:22.895021 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-4b1323ca-07e4-43b3-b6de-b97f55f2e551 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-997688769" status: 202 len: 0 microversion: 2.1 time: 0.026191 May 23 12:53:22.895989 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 373/757] 10.222.0.45 () {58 vars in 1217 bytes} [Mon May 23 12:53:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-997688769 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:53:23.555930 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2453ab15-26f2-4317-9fa5-176c689ba978 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:23.556716 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2453ab15-26f2-4317-9fa5-176c689ba978 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:23.562909 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2453ab15-26f2-4317-9fa5-176c689ba978 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:23.563480 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2453ab15-26f2-4317-9fa5-176c689ba978 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:23.564315 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2453ab15-26f2-4317-9fa5-176c689ba978 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:23.564811 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2453ab15-26f2-4317-9fa5-176c689ba978 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:23.770951 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2453ab15-26f2-4317-9fa5-176c689ba978 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:23.782427 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2453ab15-26f2-4317-9fa5-176c689ba978 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:23.784493 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2453ab15-26f2-4317-9fa5-176c689ba978 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:23.786167 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2453ab15-26f2-4317-9fa5-176c689ba978 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.235144 May 23 12:53:23.797717 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 385/758] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:23 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:24.806611 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-97fb17fe-305b-44e9-918e-c2eb18a00bd0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:24.808381 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-97fb17fe-305b-44e9-918e-c2eb18a00bd0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:24.817488 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-97fb17fe-305b-44e9-918e-c2eb18a00bd0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:24.826579 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-97fb17fe-305b-44e9-918e-c2eb18a00bd0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:24.827550 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-97fb17fe-305b-44e9-918e-c2eb18a00bd0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:24.828182 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-97fb17fe-305b-44e9-918e-c2eb18a00bd0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:25.012444 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-82f527c3-3b90-49b3-b2b4-ed39cd5d347f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:25.013006 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-82f527c3-3b90-49b3-b2b4-ed39cd5d347f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:25.019747 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-82f527c3-3b90-49b3-b2b4-ed39cd5d347f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:25.020318 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-82f527c3-3b90-49b3-b2b4-ed39cd5d347f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:25.021299 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-82f527c3-3b90-49b3-b2b4-ed39cd5d347f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:25.021893 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-82f527c3-3b90-49b3-b2b4-ed39cd5d347f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:25.052576 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-82f527c3-3b90-49b3-b2b4-ed39cd5d347f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-82f527c3-3b90-49b3-b2b4-ed39cd5d347f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: DELETE /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 HTTP/1.1 May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:53:25.055495 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:25.056820 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'e3823dc6-846f-4822-a7d2-68e988324698'} May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:25.057700 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:25.059182 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:25.061373 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-82f527c3-3b90-49b3-b2b4-ed39cd5d347f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:25.061373 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-82f527c3-3b90-49b3-b2b4-ed39cd5d347f tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 404 len: 111 microversion: 2.1 time: 0.048481 May 23 12:53:25.061373 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 386/759] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:53:25 2022] DELETE /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:53:25.066088 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e3e49b17-dea4-4ddb-8245-7a8c21492b0a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:25.067206 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e3e49b17-dea4-4ddb-8245-7a8c21492b0a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: e3823dc6-846f-4822-a7d2-68e988324698] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:25.073961 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e3e49b17-dea4-4ddb-8245-7a8c21492b0a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:25.074522 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e3e49b17-dea4-4ddb-8245-7a8c21492b0a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:25.075405 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e3e49b17-dea4-4ddb-8245-7a8c21492b0a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:25.075908 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e3e49b17-dea4-4ddb-8245-7a8c21492b0a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:25.088319 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-97fb17fe-305b-44e9-918e-c2eb18a00bd0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:25.093554 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-e3e49b17-dea4-4ddb-8245-7a8c21492b0a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e3e49b17-dea4-4ddb-8245-7a8c21492b0a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 HTTP/1.1 May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:53:25.095279 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:25.096886 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'e3823dc6-846f-4822-a7d2-68e988324698'} May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:25.097804 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. May 23 12:53:25.099371 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:25.100681 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e3e49b17-dea4-4ddb-8245-7a8c21492b0a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance e3823dc6-846f-4822-a7d2-68e988324698 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:25.100681 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e3e49b17-dea4-4ddb-8245-7a8c21492b0a tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698" status: 404 len: 111 microversion: 2.1 time: 0.035601 May 23 12:53:25.100681 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 387/760] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:25 2022] GET /compute/v2.1/servers/e3823dc6-846f-4822-a7d2-68e988324698 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:53:25.104329 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-97fb17fe-305b-44e9-918e-c2eb18a00bd0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:25.107660 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-97fb17fe-305b-44e9-918e-c2eb18a00bd0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:25.108977 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-97fb17fe-305b-44e9-918e-c2eb18a00bd0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.307222 May 23 12:53:25.117102 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 374/761] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:24 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:26.129018 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-658f5d8b-d5f4-4aed-84f4-3771f582b247 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:26.133346 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-658f5d8b-d5f4-4aed-84f4-3771f582b247 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:26.142916 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-658f5d8b-d5f4-4aed-84f4-3771f582b247 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:26.143853 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-658f5d8b-d5f4-4aed-84f4-3771f582b247 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:26.144839 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-658f5d8b-d5f4-4aed-84f4-3771f582b247 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:26.145516 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-658f5d8b-d5f4-4aed-84f4-3771f582b247 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:26.262782 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-90cfa812-52c1-4dfe-9e89-f9c08b2abd24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:26.263839 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-90cfa812-52c1-4dfe-9e89-f9c08b2abd24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:26.276298 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-90cfa812-52c1-4dfe-9e89-f9c08b2abd24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:26.276810 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-90cfa812-52c1-4dfe-9e89-f9c08b2abd24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:26.277656 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-90cfa812-52c1-4dfe-9e89-f9c08b2abd24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:26.278091 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-90cfa812-52c1-4dfe-9e89-f9c08b2abd24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:26.319284 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-90cfa812-52c1-4dfe-9e89-f9c08b2abd24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-90cfa812-52c1-4dfe-9e89-f9c08b2abd24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: DELETE /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e HTTP/1.1 May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:53:26.321567 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:53:26.323150 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '9218894f-57e2-4c73-9114-84275fabe11e'} May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:26.324166 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:53:26.325669 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.330010 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-90cfa812-52c1-4dfe-9e89-f9c08b2abd24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:26.331784 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-90cfa812-52c1-4dfe-9e89-f9c08b2abd24 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 404 len: 111 microversion: 2.1 time: 0.072977 May 23 12:53:26.342034 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 375/762] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:53:26 2022] DELETE /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:53:26.350065 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-788c02a8-2049-4c60-86d1-cd872c33b163 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:26.350557 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-788c02a8-2049-4c60-86d1-cd872c33b163 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 9218894f-57e2-4c73-9114-84275fabe11e] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:26.363291 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-788c02a8-2049-4c60-86d1-cd872c33b163 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:26.363757 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-788c02a8-2049-4c60-86d1-cd872c33b163 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:26.364552 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-788c02a8-2049-4c60-86d1-cd872c33b163 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:26.364999 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-788c02a8-2049-4c60-86d1-cd872c33b163 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:26.382722 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-788c02a8-2049-4c60-86d1-cd872c33b163 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-788c02a8-2049-4c60-86d1-cd872c33b163 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e HTTP/1.1 May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:53:26.384889 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:53:26.386188 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '9218894f-57e2-4c73-9114-84275fabe11e'} May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:26.387078 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. May 23 12:53:26.388215 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.390668 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-788c02a8-2049-4c60-86d1-cd872c33b163 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance 9218894f-57e2-4c73-9114-84275fabe11e could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:26.391765 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-788c02a8-2049-4c60-86d1-cd872c33b163 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e" status: 404 len: 111 microversion: 2.1 time: 0.045937 May 23 12:53:26.392864 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 376/763] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:26 2022] GET /compute/v2.1/servers/9218894f-57e2-4c73-9114-84275fabe11e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:53:26.401042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-51eb4312-d5c9-4127-a910-b9bbc31890b7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:26.405772 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-51eb4312-d5c9-4127-a910-b9bbc31890b7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:26.410217 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-658f5d8b-d5f4-4aed-84f4-3771f582b247 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:26.416854 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-51eb4312-d5c9-4127-a910-b9bbc31890b7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:26.417490 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-51eb4312-d5c9-4127-a910-b9bbc31890b7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:26.418758 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-51eb4312-d5c9-4127-a910-b9bbc31890b7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:26.419078 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-658f5d8b-d5f4-4aed-84f4-3771f582b247 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:26.419696 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-51eb4312-d5c9-4127-a910-b9bbc31890b7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:26.420588 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-658f5d8b-d5f4-4aed-84f4-3771f582b247 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:26.421809 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-658f5d8b-d5f4-4aed-84f4-3771f582b247 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.298255 May 23 12:53:26.428254 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 388/764] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:26 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:26.437354 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-51eb4312-d5c9-4127-a910-b9bbc31890b7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-51eb4312-d5c9-4127-a910-b9bbc31890b7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: DELETE /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 HTTP/1.1 May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:53:26.439735 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:53:26.441030 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '99cc8749-8ab7-419e-8111-8b59e8cdf451'} May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:26.441789 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:53:26.443004 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:53:26.444154 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-51eb4312-d5c9-4127-a910-b9bbc31890b7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:26.444154 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-51eb4312-d5c9-4127-a910-b9bbc31890b7 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 404 len: 111 microversion: 2.1 time: 0.046055 May 23 12:53:26.444154 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 377/765] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:53:26 2022] DELETE /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:53:26.451812 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-35cd782a-e8ff-4c13-adce-a5986cdee526 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:26.452425 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-35cd782a-e8ff-4c13-adce-a5986cdee526 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: 99cc8749-8ab7-419e-8111-8b59e8cdf451] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:26.458960 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-35cd782a-e8ff-4c13-adce-a5986cdee526 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:26.459419 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-35cd782a-e8ff-4c13-adce-a5986cdee526 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:26.460196 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-35cd782a-e8ff-4c13-adce-a5986cdee526 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:26.460760 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-35cd782a-e8ff-4c13-adce-a5986cdee526 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:26.475444 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-35cd782a-e8ff-4c13-adce-a5986cdee526 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-35cd782a-e8ff-4c13-adce-a5986cdee526 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 HTTP/1.1 May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:53:26.478413 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:53:26.480012 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': '99cc8749-8ab7-419e-8111-8b59e8cdf451'} May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:26.480889 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. May 23 12:53:26.482356 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:26.484390 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-35cd782a-e8ff-4c13-adce-a5986cdee526 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance 99cc8749-8ab7-419e-8111-8b59e8cdf451 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:26.485475 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-35cd782a-e8ff-4c13-adce-a5986cdee526 tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451" status: 404 len: 111 microversion: 2.1 time: 0.037524 May 23 12:53:26.504408 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 389/766] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:26 2022] GET /compute/v2.1/servers/99cc8749-8ab7-419e-8111-8b59e8cdf451 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:53:27.444111 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-67fa0d89-894b-4623-8d16-4313e2a24e20 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:27.444713 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-67fa0d89-894b-4623-8d16-4313e2a24e20 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:27.453304 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-67fa0d89-894b-4623-8d16-4313e2a24e20 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:27.453750 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-67fa0d89-894b-4623-8d16-4313e2a24e20 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:27.454520 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-67fa0d89-894b-4623-8d16-4313e2a24e20 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:27.454946 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-67fa0d89-894b-4623-8d16-4313e2a24e20 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:27.664509 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e391f196-264d-4745-b97e-a05e00ab2dea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:27.664509 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e391f196-264d-4745-b97e-a05e00ab2dea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:27.667751 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e391f196-264d-4745-b97e-a05e00ab2dea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:27.668469 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e391f196-264d-4745-b97e-a05e00ab2dea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:27.669297 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e391f196-264d-4745-b97e-a05e00ab2dea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:27.671142 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e391f196-264d-4745-b97e-a05e00ab2dea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:27.686827 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-e391f196-264d-4745-b97e-a05e00ab2dea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e391f196-264d-4745-b97e-a05e00ab2dea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: DELETE /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 HTTP/1.1 May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:53:27.688342 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:53:27.689947 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'd6eb03bd-ab37-4dff-9646-6e6213c07618'} May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:27.690744 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:53:27.691887 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:27.693032 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e391f196-264d-4745-b97e-a05e00ab2dea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:27.693032 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e391f196-264d-4745-b97e-a05e00ab2dea tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 404 len: 111 microversion: 2.1 time: 0.037417 May 23 12:53:27.693032 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 390/767] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:53:27 2022] DELETE /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:53:27.697115 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-67fa0d89-894b-4623-8d16-4313e2a24e20 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:27.698310 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-bfba3351-d4f6-465e-875e-8032bcfb624b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:27.698918 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-bfba3351-d4f6-465e-875e-8032bcfb624b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] [instance: d6eb03bd-ab37-4dff-9646-6e6213c07618] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:27.705661 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bfba3351-d4f6-465e-875e-8032bcfb624b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:27.706268 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bfba3351-d4f6-465e-875e-8032bcfb624b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:27.706593 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-67fa0d89-894b-4623-8d16-4313e2a24e20 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:27.707411 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bfba3351-d4f6-465e-875e-8032bcfb624b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:27.708213 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bfba3351-d4f6-465e-875e-8032bcfb624b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:27.709059 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-67fa0d89-894b-4623-8d16-4313e2a24e20 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:27.711055 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-67fa0d89-894b-4623-8d16-4313e2a24e20 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.270271 May 23 12:53:27.723553 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 378/768] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:27 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:27.724584 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-bfba3351-d4f6-465e-875e-8032bcfb624b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] HTTP exception thrown: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-bfba3351-d4f6-465e-875e-8032bcfb624b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Request method failure captured: May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 HTTP/1.1 May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J_MdYbXTMi72XJhtCRrxc1xLghHgH7DsFWTvD_oXvQq1vy255lfcR2XcTpuaLlAfcnG1P9f7arGVRGBL6GrELLsmqDZxYjyd3mStECiNI5AIv-C9Zb7d1CDpqaDiL5hN5I-34YmL4qfNuiNQ1SXcClMJlSIL_TF6EQPUhqYHkD-ug May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:53:27.726278 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_779c7b393d37486eadf1fdc94edf7e59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 779c7b393d37486eadf1fdc94edf7e59 May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1567405794 May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 2335faffe08d4c75ab85aa124819c513 May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeNegativeTest-1567405794-project May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:53:27.732492 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'd6eb03bd-ab37-4dff-9646-6e6213c07618'} May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:27.733788 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. May 23 12:53:27.735222 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:27.736463 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-bfba3351-d4f6-465e-875e-8032bcfb624b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] Returning 404 to user: Instance d6eb03bd-ab37-4dff-9646-6e6213c07618 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:27.736463 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-bfba3351-d4f6-465e-875e-8032bcfb624b tempest-AttachVolumeNegativeTest-1567405794 tempest-AttachVolumeNegativeTest-1567405794-project] 10.222.0.45 "GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618" status: 404 len: 111 microversion: 2.1 time: 0.034031 May 23 12:53:27.736463 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 391/769] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:27 2022] GET /compute/v2.1/servers/d6eb03bd-ab37-4dff-9646-6e6213c07618 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 12:53:27.941719 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-528125d5-a4fb-42ed-b1eb-7ebdddeec1e1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'create', calling method: .version_select at 0x7f6a375e0dc0>, body: {"keypair": {"name": "tempest-keypair-1493961613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkUcLXtP0K4d20u4PBZLRBiVVurA0okIjHywpjfI8T+u0sgI2ZeIG1YktA/HAewuAzdbjBf/7gWNkQPpWai2SzVekVIp5Q319zuh8PuCb9cqwHcuKt0dE1j/28SzHtz6w=="}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:27.959950 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-528125d5-a4fb-42ed-b1eb-7ebdddeec1e1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Getting quotas for project 18e2757f7e6644099af9e5510954a391. Resources: {'key_pairs'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:53:27.965992 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-528125d5-a4fb-42ed-b1eb-7ebdddeec1e1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Getting quotas for user d96f7e82915f4563b05c20c414c23229 and project 18e2757f7e6644099af9e5510954a391. Resources: {'key_pairs'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:53:27.989954 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-528125d5-a4fb-42ed-b1eb-7ebdddeec1e1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176451 May 23 12:53:27.990563 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 379/770] 10.222.0.45 () {60 vars in 1158 bytes} [Mon May 23 12:53:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:53:28.739605 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-97acb39e-2f0c-4db7-b87c-180b88c65399 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:28.740260 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-97acb39e-2f0c-4db7-b87c-180b88c65399 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:28.750114 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-97acb39e-2f0c-4db7-b87c-180b88c65399 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:28.750826 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-97acb39e-2f0c-4db7-b87c-180b88c65399 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:28.751943 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-97acb39e-2f0c-4db7-b87c-180b88c65399 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:28.752536 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-97acb39e-2f0c-4db7-b87c-180b88c65399 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:28.779655 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:28.961546 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-97acb39e-2f0c-4db7-b87c-180b88c65399 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:28.970758 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-97acb39e-2f0c-4db7-b87c-180b88c65399 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:28.972330 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-97acb39e-2f0c-4db7-b87c-180b88c65399 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:28.973589 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-97acb39e-2f0c-4db7-b87c-180b88c65399 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.247883 May 23 12:53:28.974139 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 392/771] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:28 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:53:29.593730 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1264141915", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6157eb0-f6af-4bf6-a52c-5c90693edf1d"}], "security_groups": [{"name": "tempest-securitygroup--2046632130"}], "key_name": "tempest-keypair-1493961613", "user_data": "}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:29.715232 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] validate_networks() for [('b6157eb0-f6af-4bf6-a52c-5c90693edf1d', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:53:29.992704 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7323d838-83c6-4a5e-8f11-7b27a13a75d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:29.994605 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7323d838-83c6-4a5e-8f11-7b27a13a75d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:30.002323 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7323d838-83c6-4a5e-8f11-7b27a13a75d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:30.003154 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7323d838-83c6-4a5e-8f11-7b27a13a75d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:30.004301 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7323d838-83c6-4a5e-8f11-7b27a13a75d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:30.004968 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7323d838-83c6-4a5e-8f11-7b27a13a75d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:30.266678 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:53:30.267102 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:53:30.267575 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:53:30.267987 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:53:30.268425 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:53:30.287732 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:30.288319 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:30.289200 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:30.289790 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:30.318098 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Getting quotas for project 18e2757f7e6644099af9e5510954a391. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:53:30.325503 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Getting quotas for user d96f7e82915f4563b05c20c414c23229 and project 18e2757f7e6644099af9e5510954a391. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:53:30.352341 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7323d838-83c6-4a5e-8f11-7b27a13a75d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:30.353565 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:53:30.361375 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:53:30.363087 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7323d838-83c6-4a5e-8f11-7b27a13a75d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:30.366238 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7323d838-83c6-4a5e-8f11-7b27a13a75d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:30.369851 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7323d838-83c6-4a5e-8f11-7b27a13a75d5 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.381913 May 23 12:53:30.372479 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 393/772] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:29 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:53:30.439400 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-736470da-5d33-45fd-9b5b-c902310d2664 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.848153 May 23 12:53:30.441336 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 380/773] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:53:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:53:30.455480 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ae226b96-b21e-467e-a789-c77072a7f8a3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:30.456095 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ae226b96-b21e-467e-a789-c77072a7f8a3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:30.463414 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:30.564014 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ae226b96-b21e-467e-a789-c77072a7f8a3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:30.570943 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ae226b96-b21e-467e-a789-c77072a7f8a3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1238 microversion: 2.1 time: 0.122975 May 23 12:53:30.571513 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 394/774] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:30 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1238 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:31.389798 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-93d34599-b264-4e79-9ca3-2420057ca97f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:31.391066 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-93d34599-b264-4e79-9ca3-2420057ca97f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:31.407458 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:31.409457 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-93d34599-b264-4e79-9ca3-2420057ca97f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:31.412160 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-93d34599-b264-4e79-9ca3-2420057ca97f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:31.413183 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-93d34599-b264-4e79-9ca3-2420057ca97f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:31.417055 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-93d34599-b264-4e79-9ca3-2420057ca97f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:31.595539 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a2f72038-2882-46b1-b64d-87d45db4541d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:31.597119 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a2f72038-2882-46b1-b64d-87d45db4541d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:31.609530 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a2f72038-2882-46b1-b64d-87d45db4541d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:31.610274 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a2f72038-2882-46b1-b64d-87d45db4541d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:31.611211 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a2f72038-2882-46b1-b64d-87d45db4541d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:31.612390 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a2f72038-2882-46b1-b64d-87d45db4541d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:31.733921 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a2f72038-2882-46b1-b64d-87d45db4541d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:31.745524 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a2f72038-2882-46b1-b64d-87d45db4541d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1290 microversion: 2.1 time: 0.161424 May 23 12:53:31.749446 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 395/775] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:31 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1290 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:31.777441 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-93d34599-b264-4e79-9ca3-2420057ca97f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:31.790811 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-93d34599-b264-4e79-9ca3-2420057ca97f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:31.796801 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-93d34599-b264-4e79-9ca3-2420057ca97f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:31.798481 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-93d34599-b264-4e79-9ca3-2420057ca97f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.412595 May 23 12:53:31.813327 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 381/776] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:31 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:32.766626 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-aef02e36-8298-49e0-995f-7209c37f5611 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:32.767228 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-aef02e36-8298-49e0-995f-7209c37f5611 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:32.784224 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aef02e36-8298-49e0-995f-7209c37f5611 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:32.784952 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aef02e36-8298-49e0-995f-7209c37f5611 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:32.785981 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aef02e36-8298-49e0-995f-7209c37f5611 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:32.786427 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-aef02e36-8298-49e0-995f-7209c37f5611 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:32.819281 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2f96c354-94ae-4639-92f3-a6c1105ab878 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:32.823402 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2f96c354-94ae-4639-92f3-a6c1105ab878 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:32.849841 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2f96c354-94ae-4639-92f3-a6c1105ab878 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:32.850776 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2f96c354-94ae-4639-92f3-a6c1105ab878 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:32.852517 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2f96c354-94ae-4639-92f3-a6c1105ab878 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:32.853187 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2f96c354-94ae-4639-92f3-a6c1105ab878 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:32.862927 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-aef02e36-8298-49e0-995f-7209c37f5611 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:32.872225 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-aef02e36-8298-49e0-995f-7209c37f5611 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1296 microversion: 2.1 time: 0.109196 May 23 12:53:32.873371 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 396/777] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:32 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:33.082579 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2f96c354-94ae-4639-92f3-a6c1105ab878 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:33.093675 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2f96c354-94ae-4639-92f3-a6c1105ab878 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:33.095442 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2f96c354-94ae-4639-92f3-a6c1105ab878 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:33.096611 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2f96c354-94ae-4639-92f3-a6c1105ab878 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.281383 May 23 12:53:33.097376 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 382/778] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:32 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:53:33.823978 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-99d3b945-f0be-4a49-a566-3b4e0cdeb2b2 tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] Action: 'create', calling method: .version_select at 0x7f6a36d648b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-55218227", "metadata": {"Type": "work"}}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:33.897285 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-4b8c0e9b-418c-4ba5-905c-396e3a12ac27 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:33.898238 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-4b8c0e9b-418c-4ba5-905c-396e3a12ac27 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:33.905657 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b8c0e9b-418c-4ba5-905c-396e3a12ac27 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:33.906294 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b8c0e9b-418c-4ba5-905c-396e3a12ac27 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:33.924171 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b8c0e9b-418c-4ba5-905c-396e3a12ac27 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:33.924635 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b8c0e9b-418c-4ba5-905c-396e3a12ac27 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:34.173541 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-99d3b945-f0be-4a49-a566-3b4e0cdeb2b2 tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.485700 May 23 12:53:34.174701 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 397/779] 10.222.0.45 () {60 vars in 1155 bytes} [Mon May 23 12:53:33 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 488 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 12:53:34.181378 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-720734a7-cdc8-46bf-a2e9-7319ccd8e421 req-1880a58f-9ccb-44bc-870b-4e27e7c7daa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73540f41-a90c-4826-8a73-3883ce48a0d1", "tag": "11784d14-fd57-43bb-bd2e-f74c6df1e123"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:34.190944 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-720734a7-cdc8-46bf-a2e9-7319ccd8e421 req-1880a58f-9ccb-44bc-870b-4e27e7c7daa6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:34.191160 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-4b8c0e9b-418c-4ba5-905c-396e3a12ac27 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:34.191389 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-720734a7-cdc8-46bf-a2e9-7319ccd8e421 req-1880a58f-9ccb-44bc-870b-4e27e7c7daa6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:34.205283 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-4b8c0e9b-418c-4ba5-905c-396e3a12ac27 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1364 microversion: 2.1 time: 0.319202 May 23 12:53:34.205566 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-720734a7-cdc8-46bf-a2e9-7319ccd8e421 req-1880a58f-9ccb-44bc-870b-4e27e7c7daa6 service nova] Creating event network-changed:11784d14-fd57-43bb-bd2e-f74c6df1e123 for instance 73540f41-a90c-4826-8a73-3883ce48a0d1 on hv-cinder-maste May 23 12:53:34.214016 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-720734a7-cdc8-46bf-a2e9-7319ccd8e421 req-1880a58f-9ccb-44bc-870b-4e27e7c7daa6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037829 May 23 12:53:34.214884 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 398/780] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:34.216239 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 383/781] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:33 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:34.220917 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-020f3526-0710-416f-86b2-98177825b72a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:34.221130 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-af700ddf-25d2-473b-a9a5-1c37371a2905 tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] Calling method '.version_select at 0x7f6a3763d430>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:34.221958 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-020f3526-0710-416f-86b2-98177825b72a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:34.229448 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-020f3526-0710-416f-86b2-98177825b72a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:34.230310 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-020f3526-0710-416f-86b2-98177825b72a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:34.231140 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-020f3526-0710-416f-86b2-98177825b72a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:34.231734 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-020f3526-0710-416f-86b2-98177825b72a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:34.284749 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-af700ddf-25d2-473b-a9a5-1c37371a2905 tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29" status: 200 len: 351 microversion: 2.1 time: 0.067364 May 23 12:53:34.285458 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 384/782] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:53:34 2022] GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29 => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:34.380093 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-020f3526-0710-416f-86b2-98177825b72a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:34.388720 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-020f3526-0710-416f-86b2-98177825b72a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:34.390497 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-020f3526-0710-416f-86b2-98177825b72a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:34.391702 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-020f3526-0710-416f-86b2-98177825b72a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.175464 May 23 12:53:34.392264 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 399/783] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:34 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:35.224097 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9418c1c7-4efb-4d0d-83f3-7fe3db2b267f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:35.224702 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9418c1c7-4efb-4d0d-83f3-7fe3db2b267f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:35.231359 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9418c1c7-4efb-4d0d-83f3-7fe3db2b267f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:35.231813 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9418c1c7-4efb-4d0d-83f3-7fe3db2b267f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:35.232583 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9418c1c7-4efb-4d0d-83f3-7fe3db2b267f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:35.233023 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9418c1c7-4efb-4d0d-83f3-7fe3db2b267f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:35.296562 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a65d19f0-b7a1-456b-a083-c284522937aa tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] Calling method '.version_select at 0x7f6a3ff1ee50>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:35.350689 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a65d19f0-b7a1-456b-a083-c284522937aa tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29" status: 200 len: 352 microversion: 2.1 time: 0.057885 May 23 12:53:35.352175 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 400/784] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:53:35 2022] GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:53:35.362951 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5b48d357-c1c3-427c-96fd-198a77072753 tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] Calling method '.version_select at 0x7f6a36be0e50>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:35.410656 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5b48d357-c1c3-427c-96fd-198a77072753 tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29" status: 200 len: 352 microversion: 2.1 time: 0.051581 May 23 12:53:35.411225 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 401/785] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:53:35 2022] GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:53:35.418628 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6bb08d78-b70e-4d11-8050-0180be4e7842 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:35.419232 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6bb08d78-b70e-4d11-8050-0180be4e7842 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:35.426220 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6bb08d78-b70e-4d11-8050-0180be4e7842 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:35.426662 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6bb08d78-b70e-4d11-8050-0180be4e7842 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:35.427426 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6bb08d78-b70e-4d11-8050-0180be4e7842 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:35.427856 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6bb08d78-b70e-4d11-8050-0180be4e7842 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:35.440805 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9418c1c7-4efb-4d0d-83f3-7fe3db2b267f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:35.449269 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9418c1c7-4efb-4d0d-83f3-7fe3db2b267f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1364 microversion: 2.1 time: 0.229608 May 23 12:53:35.450213 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 385/786] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:35 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:35.455122 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-cc3e956e-4100-417c-8ac7-9c1d3754cf01 tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] Calling method '.version_select at 0x7f6a3763db80>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:35.527573 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-cc3e956e-4100-417c-8ac7-9c1d3754cf01 tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29" status: 202 len: 0 microversion: 2.1 time: 0.076104 May 23 12:53:35.528148 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 386/787] 10.222.0.45 () {58 vars in 1247 bytes} [Mon May 23 12:53:35 2022] DELETE /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:53:35.536472 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-66c08c3f-87be-42f2-9ddf-95718c910e9c tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] Calling method '.version_select at 0x7f6a3750bca0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:35.587376 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-66c08c3f-87be-42f2-9ddf-95718c910e9c tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29" status: 200 len: 351 microversion: 2.1 time: 0.054748 May 23 12:53:35.587943 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 387/788] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:53:35 2022] GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:53:35.588567 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6bb08d78-b70e-4d11-8050-0180be4e7842 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:35.597251 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6bb08d78-b70e-4d11-8050-0180be4e7842 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:35.598750 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-6bb08d78-b70e-4d11-8050-0180be4e7842 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:35.600001 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6bb08d78-b70e-4d11-8050-0180be4e7842 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.187774 May 23 12:53:35.600792 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 402/789] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:35 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:36.467724 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1ad91036-ce88-4da3-95c8-73ae64c62666 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:36.468329 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1ad91036-ce88-4da3-95c8-73ae64c62666 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:36.475124 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1ad91036-ce88-4da3-95c8-73ae64c62666 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:36.475569 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1ad91036-ce88-4da3-95c8-73ae64c62666 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:36.476575 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1ad91036-ce88-4da3-95c8-73ae64c62666 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:36.477098 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1ad91036-ce88-4da3-95c8-73ae64c62666 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:36.601643 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f0147678-50fe-41fa-a69f-0ad99f80f71b tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] Calling method '.version_select at 0x7f6a36be23a0>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:36.611984 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-1ad91036-ce88-4da3-95c8-73ae64c62666 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:36.624469 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1ad91036-ce88-4da3-95c8-73ae64c62666 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1364 microversion: 2.1 time: 0.160766 May 23 12:53:36.625051 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 388/790] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:36 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:36.632169 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-cd6605da-dd05-4fb5-b0a3-2ebfb8cd71ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:36.632169 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-cd6605da-dd05-4fb5-b0a3-2ebfb8cd71ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:36.633206 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-f0147678-50fe-41fa-a69f-0ad99f80f71b tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] HTTP exception thrown: Volume 2dcde9b0-ba0f-4463-9457-98b70705df29 could not be found. May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f0147678-50fe-41fa-a69f-0ad99f80f71b tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] Request method failure captured: May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29 HTTP/1.1 May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4PNJmzI4upUITDK4DMyyNxL1iTKZ6NJ9NXucxB1I0611pW9pufzPmJodetNLFvJXy4aLDgX6bYY7C0CKaiSUMQ-xwGSjZ0mM_nhSEu57Se_ZNEb6tcswN_4HLwE39wQCkCh0A-ejFEuU_ZW6uryCohXTqw47trOSoylfJaeOr6XtWs May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 9450793b3dc54f8b86c2ccf6f6b6360f May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesGetTestJSON-100057975 May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:53:36.635536 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9450793b3dc54f8b86c2ccf6f6b6360f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9450793b3dc54f8b86c2ccf6f6b6360f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9450793b3dc54f8b86c2ccf6f6b6360f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9450793b3dc54f8b86c2ccf6f6b6360f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesGetTestJSON-100057975 May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 9450793b3dc54f8b86c2ccf6f6b6360f May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesGetTestJSON-100057975 May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesGetTestJSON-100057975-project May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 49bcd4d0cd284d74a5783381571e6e23 May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesGetTestJSON-100057975-project May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Volume 2dcde9b0-ba0f-4463-9457-98b70705df29 could not be found. May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': '2dcde9b0-ba0f-4463-9457-98b70705df29'} May 23 12:53:36.637166 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2dcde9b0-ba0f-4463-9457-98b70705df29 could not be found. (HTTP 404) (Request-ID: req-7d1eed3c-2277-418f-8352-cd0ed2348508) May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:36.638145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:53:36.639381 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2dcde9b0-ba0f-4463-9457-98b70705df29 could not be found. May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 12:53:36.640689 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2dcde9b0-ba0f-4463-9457-98b70705df29 could not be found. May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2dcde9b0-ba0f-4463-9457-98b70705df29 could not be found. May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:53:36.642433 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f0147678-50fe-41fa-a69f-0ad99f80f71b tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] Returning 404 to user: Volume 2dcde9b0-ba0f-4463-9457-98b70705df29 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:53:36.643801 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cd6605da-dd05-4fb5-b0a3-2ebfb8cd71ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:36.643933 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f0147678-50fe-41fa-a69f-0ad99f80f71b tempest-VolumesGetTestJSON-100057975 tempest-VolumesGetTestJSON-100057975-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29" status: 404 len: 109 microversion: 2.1 time: 0.040970 May 23 12:53:36.644028 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cd6605da-dd05-4fb5-b0a3-2ebfb8cd71ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:36.644117 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 403/791] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:53:36 2022] GET /compute/v2.1/os-volumes/2dcde9b0-ba0f-4463-9457-98b70705df29 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:53:36.644205 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cd6605da-dd05-4fb5-b0a3-2ebfb8cd71ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:36.644205 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cd6605da-dd05-4fb5-b0a3-2ebfb8cd71ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:36.779325 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-cd6605da-dd05-4fb5-b0a3-2ebfb8cd71ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:36.787341 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-cd6605da-dd05-4fb5-b0a3-2ebfb8cd71ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:36.789708 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-cd6605da-dd05-4fb5-b0a3-2ebfb8cd71ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:36.790893 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-cd6605da-dd05-4fb5-b0a3-2ebfb8cd71ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.164833 May 23 12:53:36.791442 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 389/792] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:36 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:37.642921 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-0b4377b3-e481-4c60-bc98-a6219e24d965 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:37.644450 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-0b4377b3-e481-4c60-bc98-a6219e24d965 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:37.651952 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0b4377b3-e481-4c60-bc98-a6219e24d965 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:37.652400 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0b4377b3-e481-4c60-bc98-a6219e24d965 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:37.653187 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0b4377b3-e481-4c60-bc98-a6219e24d965 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:37.653690 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0b4377b3-e481-4c60-bc98-a6219e24d965 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:37.794441 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-0b4377b3-e481-4c60-bc98-a6219e24d965 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:37.802377 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-0b4377b3-e481-4c60-bc98-a6219e24d965 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1364 microversion: 2.1 time: 0.164447 May 23 12:53:37.803230 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 404/793] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:37 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:37.810857 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e2039523-0034-4dcb-bceb-c68ee25d17dc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:37.811553 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e2039523-0034-4dcb-bceb-c68ee25d17dc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:37.818368 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2039523-0034-4dcb-bceb-c68ee25d17dc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:37.818819 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2039523-0034-4dcb-bceb-c68ee25d17dc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:37.820256 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2039523-0034-4dcb-bceb-c68ee25d17dc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:37.820604 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e2039523-0034-4dcb-bceb-c68ee25d17dc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:38.233743 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e2039523-0034-4dcb-bceb-c68ee25d17dc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:38.241630 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e2039523-0034-4dcb-bceb-c68ee25d17dc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:38.243181 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e2039523-0034-4dcb-bceb-c68ee25d17dc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:38.244324 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e2039523-0034-4dcb-bceb-c68ee25d17dc tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1744 microversion: 2.20 time: 0.437677 May 23 12:53:38.249886 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 390/794] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:37 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1744 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:53:38.820416 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b7b238e3-4352-409e-9b0b-ab023cf61a5d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:38.821020 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b7b238e3-4352-409e-9b0b-ab023cf61a5d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:38.828501 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b7b238e3-4352-409e-9b0b-ab023cf61a5d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:38.828949 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b7b238e3-4352-409e-9b0b-ab023cf61a5d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:38.829807 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b7b238e3-4352-409e-9b0b-ab023cf61a5d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:38.830236 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b7b238e3-4352-409e-9b0b-ab023cf61a5d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:38.981834 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b7b238e3-4352-409e-9b0b-ab023cf61a5d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:38.984106 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b7b238e3-4352-409e-9b0b-ab023cf61a5d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1364 microversion: 2.1 time: 0.168084 May 23 12:53:38.984658 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 405/795] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:38 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:53:39.263332 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c115c2e4-32c6-4b98-8115-f997de514970 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:39.263935 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c115c2e4-32c6-4b98-8115-f997de514970 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:39.270372 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c115c2e4-32c6-4b98-8115-f997de514970 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:39.270820 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c115c2e4-32c6-4b98-8115-f997de514970 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:39.271574 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c115c2e4-32c6-4b98-8115-f997de514970 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:39.272010 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c115c2e4-32c6-4b98-8115-f997de514970 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:39.290292 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:39.402480 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c115c2e4-32c6-4b98-8115-f997de514970 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:39.410298 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c115c2e4-32c6-4b98-8115-f997de514970 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:39.411791 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c115c2e4-32c6-4b98-8115-f997de514970 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:39.413650 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c115c2e4-32c6-4b98-8115-f997de514970 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1744 microversion: 2.20 time: 0.153539 May 23 12:53:39.414218 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 391/796] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:39 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:39.896907 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-b52675f9-ccd5-4ca8-b7c2-c9293fc43ae1 req-cb9909fb-53c7-48b8-bb00-8c4035494a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73540f41-a90c-4826-8a73-3883ce48a0d1", "name": "network-vif-plugged", "status": "completed", "tag": "11784d14-fd57-43bb-bd2e-f74c6df1e123"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:39.907669 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-b52675f9-ccd5-4ca8-b7c2-c9293fc43ae1 req-cb9909fb-53c7-48b8-bb00-8c4035494a5f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:39.908107 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-b52675f9-ccd5-4ca8-b7c2-c9293fc43ae1 req-cb9909fb-53c7-48b8-bb00-8c4035494a5f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:39.920391 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-b52675f9-ccd5-4ca8-b7c2-c9293fc43ae1 req-cb9909fb-53c7-48b8-bb00-8c4035494a5f service nova] Creating event network-vif-plugged:11784d14-fd57-43bb-bd2e-f74c6df1e123 for instance 73540f41-a90c-4826-8a73-3883ce48a0d1 on hv-cinder-maste May 23 12:53:39.925449 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-b52675f9-ccd5-4ca8-b7c2-c9293fc43ae1 req-cb9909fb-53c7-48b8-bb00-8c4035494a5f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195146 May 23 12:53:39.926190 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 406/797] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:40.001748 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-87aedc68-201c-4338-b397-1da3dbbbbbb4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:40.002682 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-87aedc68-201c-4338-b397-1da3dbbbbbb4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:40.012027 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-87aedc68-201c-4338-b397-1da3dbbbbbb4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:40.012486 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-87aedc68-201c-4338-b397-1da3dbbbbbb4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:40.013284 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-87aedc68-201c-4338-b397-1da3dbbbbbb4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:40.019184 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-87aedc68-201c-4338-b397-1da3dbbbbbb4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:40.229955 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-87aedc68-201c-4338-b397-1da3dbbbbbb4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:40.238453 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-87aedc68-201c-4338-b397-1da3dbbbbbb4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1364 microversion: 2.1 time: 0.241223 May 23 12:53:40.239751 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 392/798] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:39 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:40.435226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-33e98523-ba6b-4264-8e82-43157ea4187d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:40.435927 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-33e98523-ba6b-4264-8e82-43157ea4187d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:40.446292 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-33e98523-ba6b-4264-8e82-43157ea4187d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:40.446497 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-33e98523-ba6b-4264-8e82-43157ea4187d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:40.447274 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-33e98523-ba6b-4264-8e82-43157ea4187d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:40.447709 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-33e98523-ba6b-4264-8e82-43157ea4187d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:40.570641 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=2 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:40.614727 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-33e98523-ba6b-4264-8e82-43157ea4187d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:40.624817 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-33e98523-ba6b-4264-8e82-43157ea4187d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:40.626878 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-33e98523-ba6b-4264-8e82-43157ea4187d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:40.628283 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-33e98523-ba6b-4264-8e82-43157ea4187d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1739 microversion: 2.20 time: 0.200099 May 23 12:53:40.629093 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 407/799] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:40 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:41.256349 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-012a80ee-db0f-42ca-90eb-525184085d8e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:41.258809 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-012a80ee-db0f-42ca-90eb-525184085d8e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:41.269831 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:41.271328 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=10 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:41.275906 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-012a80ee-db0f-42ca-90eb-525184085d8e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:41.277012 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-012a80ee-db0f-42ca-90eb-525184085d8e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:41.277820 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-012a80ee-db0f-42ca-90eb-525184085d8e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:41.278256 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-012a80ee-db0f-42ca-90eb-525184085d8e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:41.467972 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-012a80ee-db0f-42ca-90eb-525184085d8e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:41.477453 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-012a80ee-db0f-42ca-90eb-525184085d8e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1364 microversion: 2.1 time: 0.225314 May 23 12:53:41.481683 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 393/800] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:41 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:41.648583 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-40118637-3b33-4bbe-a0ba-2b896dd8a1ff tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:41.649234 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-40118637-3b33-4bbe-a0ba-2b896dd8a1ff tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:41.666828 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-40118637-3b33-4bbe-a0ba-2b896dd8a1ff tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:41.667275 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-40118637-3b33-4bbe-a0ba-2b896dd8a1ff tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:41.676164 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-40118637-3b33-4bbe-a0ba-2b896dd8a1ff tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:41.677533 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-40118637-3b33-4bbe-a0ba-2b896dd8a1ff tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:41.931696 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-40118637-3b33-4bbe-a0ba-2b896dd8a1ff tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:41.941411 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-40118637-3b33-4bbe-a0ba-2b896dd8a1ff tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:41.942691 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-afd6f9d8-1c3e-4cd4-ab46-f952ba34e682 req-ebc388d4-2236-4b14-80f0-d6f08367b15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2", "name": "network-vif-plugged", "status": "completed", "tag": "09a5c406-d2e6-4886-a574-22f77e9b109c"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:41.943578 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-40118637-3b33-4bbe-a0ba-2b896dd8a1ff tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:41.945576 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-40118637-3b33-4bbe-a0ba-2b896dd8a1ff tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1739 microversion: 2.20 time: 0.301310 May 23 12:53:41.949750 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 408/801] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:41 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:41.953010 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-afd6f9d8-1c3e-4cd4-ab46-f952ba34e682 req-ebc388d4-2236-4b14-80f0-d6f08367b15f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:41.953669 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-afd6f9d8-1c3e-4cd4-ab46-f952ba34e682 req-ebc388d4-2236-4b14-80f0-d6f08367b15f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:41.969597 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-afd6f9d8-1c3e-4cd4-ab46-f952ba34e682 req-ebc388d4-2236-4b14-80f0-d6f08367b15f service nova] Creating event network-vif-plugged:09a5c406-d2e6-4886-a574-22f77e9b109c for instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 on hv-cinder-maste May 23 12:53:41.975390 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-afd6f9d8-1c3e-4cd4-ab46-f952ba34e682 req-ebc388d4-2236-4b14-80f0-d6f08367b15f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036804 May 23 12:53:41.980095 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 394/802] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:53:42.494701 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5b29dd83-e5a3-4ed1-82a0-6da37f1b2f5a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:42.495404 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5b29dd83-e5a3-4ed1-82a0-6da37f1b2f5a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:42.502434 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b29dd83-e5a3-4ed1-82a0-6da37f1b2f5a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:42.503185 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b29dd83-e5a3-4ed1-82a0-6da37f1b2f5a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:42.504044 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b29dd83-e5a3-4ed1-82a0-6da37f1b2f5a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:42.504532 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b29dd83-e5a3-4ed1-82a0-6da37f1b2f5a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:42.650614 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5b29dd83-e5a3-4ed1-82a0-6da37f1b2f5a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:42.658484 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5b29dd83-e5a3-4ed1-82a0-6da37f1b2f5a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1550 microversion: 2.1 time: 0.169032 May 23 12:53:42.659392 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 409/803] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:53:42 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:53:42.677070 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-96957189-7e3a-4376-933d-e9745671d08b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:42.678288 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-96957189-7e3a-4376-933d-e9745671d08b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:42.685098 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96957189-7e3a-4376-933d-e9745671d08b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:42.685586 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96957189-7e3a-4376-933d-e9745671d08b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:42.686353 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96957189-7e3a-4376-933d-e9745671d08b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:42.686792 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-96957189-7e3a-4376-933d-e9745671d08b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:42.776319 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-96957189-7e3a-4376-933d-e9745671d08b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103816 May 23 12:53:42.777188 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 395/804] 10.222.0.45 () {58 vars in 1274 bytes} [Mon May 23 12:53:42 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:42.974482 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4882bb4f-cc2e-4d7e-b6fa-f6812748d4a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:42.978443 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4882bb4f-cc2e-4d7e-b6fa-f6812748d4a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:42.996595 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4882bb4f-cc2e-4d7e-b6fa-f6812748d4a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:42.997084 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4882bb4f-cc2e-4d7e-b6fa-f6812748d4a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:42.997940 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4882bb4f-cc2e-4d7e-b6fa-f6812748d4a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:42.998447 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4882bb4f-cc2e-4d7e-b6fa-f6812748d4a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:43.284361 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4882bb4f-cc2e-4d7e-b6fa-f6812748d4a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:43.307673 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4882bb4f-cc2e-4d7e-b6fa-f6812748d4a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:43.312518 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4882bb4f-cc2e-4d7e-b6fa-f6812748d4a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:43.313816 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4882bb4f-cc2e-4d7e-b6fa-f6812748d4a6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1739 microversion: 2.20 time: 0.348481 May 23 12:53:43.315417 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 410/805] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:42 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1739 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:44.063665 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-7f36c6e9-dc19-4863-b2f9-a648e84a3486 req-13bedf0e-ecd9-4f02-beb0-de72bc08e9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73540f41-a90c-4826-8a73-3883ce48a0d1", "tag": "11784d14-fd57-43bb-bd2e-f74c6df1e123"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:44.078743 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-7f36c6e9-dc19-4863-b2f9-a648e84a3486 req-13bedf0e-ecd9-4f02-beb0-de72bc08e9a0 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:44.080167 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-7f36c6e9-dc19-4863-b2f9-a648e84a3486 req-13bedf0e-ecd9-4f02-beb0-de72bc08e9a0 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:44.098827 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-7f36c6e9-dc19-4863-b2f9-a648e84a3486 req-13bedf0e-ecd9-4f02-beb0-de72bc08e9a0 service nova] Creating event network-changed:11784d14-fd57-43bb-bd2e-f74c6df1e123 for instance 73540f41-a90c-4826-8a73-3883ce48a0d1 on hv-cinder-maste May 23 12:53:44.105425 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-7f36c6e9-dc19-4863-b2f9-a648e84a3486 req-13bedf0e-ecd9-4f02-beb0-de72bc08e9a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126637 May 23 12:53:44.106296 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 396/806] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:53:44.333772 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f32103bd-e110-4054-bab8-b432fee44e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:44.334409 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f32103bd-e110-4054-bab8-b432fee44e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:44.347544 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f32103bd-e110-4054-bab8-b432fee44e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:44.347993 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f32103bd-e110-4054-bab8-b432fee44e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:44.348779 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f32103bd-e110-4054-bab8-b432fee44e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:44.355284 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f32103bd-e110-4054-bab8-b432fee44e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:44.529671 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f32103bd-e110-4054-bab8-b432fee44e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:44.539423 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f32103bd-e110-4054-bab8-b432fee44e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:44.541011 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f32103bd-e110-4054-bab8-b432fee44e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:44.542485 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f32103bd-e110-4054-bab8-b432fee44e1b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1739 microversion: 2.20 time: 0.212814 May 23 12:53:44.553178 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 411/807] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:44 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:45.560669 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a7323741-d24d-4fa5-967b-ea10df900462 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:45.561401 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a7323741-d24d-4fa5-967b-ea10df900462 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:45.571583 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7323741-d24d-4fa5-967b-ea10df900462 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:45.572621 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7323741-d24d-4fa5-967b-ea10df900462 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:45.573611 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7323741-d24d-4fa5-967b-ea10df900462 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:45.574226 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7323741-d24d-4fa5-967b-ea10df900462 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:45.767765 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a7323741-d24d-4fa5-967b-ea10df900462 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:45.780264 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a7323741-d24d-4fa5-967b-ea10df900462 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:45.788077 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a7323741-d24d-4fa5-967b-ea10df900462 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:45.790520 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a7323741-d24d-4fa5-967b-ea10df900462 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1739 microversion: 2.20 time: 0.234272 May 23 12:53:45.792712 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 397/808] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:45 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:46.811738 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-bb843ecc-8080-48e4-8805-500d5c3c9a78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:46.812346 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-bb843ecc-8080-48e4-8805-500d5c3c9a78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:46.827021 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb843ecc-8080-48e4-8805-500d5c3c9a78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:46.827472 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb843ecc-8080-48e4-8805-500d5c3c9a78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:46.828251 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb843ecc-8080-48e4-8805-500d5c3c9a78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:46.828683 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb843ecc-8080-48e4-8805-500d5c3c9a78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:47.003316 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-bb843ecc-8080-48e4-8805-500d5c3c9a78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:47.013204 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-bb843ecc-8080-48e4-8805-500d5c3c9a78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:47.015045 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-bb843ecc-8080-48e4-8805-500d5c3c9a78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:47.017686 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-bb843ecc-8080-48e4-8805-500d5c3c9a78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1739 microversion: 2.20 time: 0.209277 May 23 12:53:47.021213 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 412/809] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:46 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:48.035915 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c13d0aa2-5f3f-4823-b58d-49589b08538a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:48.036583 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-c13d0aa2-5f3f-4823-b58d-49589b08538a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:48.046945 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c13d0aa2-5f3f-4823-b58d-49589b08538a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:48.047588 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c13d0aa2-5f3f-4823-b58d-49589b08538a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:48.051193 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c13d0aa2-5f3f-4823-b58d-49589b08538a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:48.051649 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-c13d0aa2-5f3f-4823-b58d-49589b08538a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:48.287305 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c13d0aa2-5f3f-4823-b58d-49589b08538a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:48.296395 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c13d0aa2-5f3f-4823-b58d-49589b08538a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:48.298055 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-c13d0aa2-5f3f-4823-b58d-49589b08538a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:48.299471 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c13d0aa2-5f3f-4823-b58d-49589b08538a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1739 microversion: 2.20 time: 0.267543 May 23 12:53:48.300133 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 398/810] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:48 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:49.318051 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-005cd545-a7cc-4876-a48a-dc40f9b215d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:49.318661 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-005cd545-a7cc-4876-a48a-dc40f9b215d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:49.328033 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-005cd545-a7cc-4876-a48a-dc40f9b215d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:49.328477 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-005cd545-a7cc-4876-a48a-dc40f9b215d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:49.329518 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-005cd545-a7cc-4876-a48a-dc40f9b215d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:49.330141 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-005cd545-a7cc-4876-a48a-dc40f9b215d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:49.487395 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-005cd545-a7cc-4876-a48a-dc40f9b215d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:49.498141 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-005cd545-a7cc-4876-a48a-dc40f9b215d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:49.499850 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-005cd545-a7cc-4876-a48a-dc40f9b215d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:49.501819 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-005cd545-a7cc-4876-a48a-dc40f9b215d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1739 microversion: 2.20 time: 0.187075 May 23 12:53:49.512745 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 413/811] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:49 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:50.520307 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-baee4b8c-6886-463d-a3d1-d5a16002c3e0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:50.521250 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-baee4b8c-6886-463d-a3d1-d5a16002c3e0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:50.528410 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-baee4b8c-6886-463d-a3d1-d5a16002c3e0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:50.528877 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-baee4b8c-6886-463d-a3d1-d5a16002c3e0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:50.529667 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-baee4b8c-6886-463d-a3d1-d5a16002c3e0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:50.530119 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-baee4b8c-6886-463d-a3d1-d5a16002c3e0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:50.732117 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-baee4b8c-6886-463d-a3d1-d5a16002c3e0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:50.740329 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-baee4b8c-6886-463d-a3d1-d5a16002c3e0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:50.742007 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-baee4b8c-6886-463d-a3d1-d5a16002c3e0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:50.743167 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-baee4b8c-6886-463d-a3d1-d5a16002c3e0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1721 microversion: 2.20 time: 0.226757 May 23 12:53:50.743728 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 399/812] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:50 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:51.762162 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c698223e-e520-4fa1-b381-9f177b8afdac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:51.762971 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c698223e-e520-4fa1-b381-9f177b8afdac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:51.769848 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c698223e-e520-4fa1-b381-9f177b8afdac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:51.770291 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c698223e-e520-4fa1-b381-9f177b8afdac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:51.771194 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c698223e-e520-4fa1-b381-9f177b8afdac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:51.771471 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c698223e-e520-4fa1-b381-9f177b8afdac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:51.906495 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c698223e-e520-4fa1-b381-9f177b8afdac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:51.915623 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c698223e-e520-4fa1-b381-9f177b8afdac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:51.917101 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c698223e-e520-4fa1-b381-9f177b8afdac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:51.918276 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c698223e-e520-4fa1-b381-9f177b8afdac tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1721 microversion: 2.20 time: 0.160041 May 23 12:53:51.921182 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 414/813] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:51 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:52.937181 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-aa6cbfaf-97b8-4460-a081-8596095689ab tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:52.937795 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-aa6cbfaf-97b8-4460-a081-8596095689ab tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:52.944478 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-aa6cbfaf-97b8-4460-a081-8596095689ab tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:52.944927 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-aa6cbfaf-97b8-4460-a081-8596095689ab tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:52.945721 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-aa6cbfaf-97b8-4460-a081-8596095689ab tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:52.946159 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-aa6cbfaf-97b8-4460-a081-8596095689ab tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:53.086324 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-aa6cbfaf-97b8-4460-a081-8596095689ab tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:53.098520 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-aa6cbfaf-97b8-4460-a081-8596095689ab tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:53.101845 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-aa6cbfaf-97b8-4460-a081-8596095689ab tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:53.103609 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-aa6cbfaf-97b8-4460-a081-8596095689ab tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1664 microversion: 2.20 time: 0.170089 May 23 12:53:53.113971 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 400/814] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:52 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:53.122366 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-327042f5-ff2d-4f7b-bae4-30c5ccecf56f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f905c7f7-8ba7-4a7f-ab48-4d6f048bf7dc"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:53.124092 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-327042f5-ff2d-4f7b-bae4-30c5ccecf56f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:53.131218 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-327042f5-ff2d-4f7b-bae4-30c5ccecf56f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:53.132039 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-327042f5-ff2d-4f7b-bae4-30c5ccecf56f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:53.132803 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-327042f5-ff2d-4f7b-bae4-30c5ccecf56f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:53.133411 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-327042f5-ff2d-4f7b-bae4-30c5ccecf56f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:53.150957 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=100 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:53:53.446371 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-327042f5-ff2d-4f7b-bae4-30c5ccecf56f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "POST /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327826 May 23 12:53:53.456703 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 415/815] 10.222.0.45 () {62 vars in 1363 bytes} [Mon May 23 12:53:53 2022] POST /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/os-volume_attachments => generated 188 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 12:53:53.569674 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-635d2827-18da-4a80-b4df-05be3055327e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:53.570167 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-635d2827-18da-4a80-b4df-05be3055327e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:53.577479 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-635d2827-18da-4a80-b4df-05be3055327e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:53.577863 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-635d2827-18da-4a80-b4df-05be3055327e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:53.579218 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-635d2827-18da-4a80-b4df-05be3055327e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:53.579663 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-635d2827-18da-4a80-b4df-05be3055327e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:53.617929 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-4c04fac6-b5c5-4652-8f67-871265ec9e96 req-a0bc9bdc-920a-48be-8961-d1998e032502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2", "name": "network-vif-unplugged", "status": "completed", "tag": "09a5c406-d2e6-4886-a574-22f77e9b109c"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:53.629643 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-4c04fac6-b5c5-4652-8f67-871265ec9e96 req-a0bc9bdc-920a-48be-8961-d1998e032502 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:53.630347 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-4c04fac6-b5c5-4652-8f67-871265ec9e96 req-a0bc9bdc-920a-48be-8961-d1998e032502 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:53.645861 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.compute.server_external_events [req-4c04fac6-b5c5-4652-8f67-871265ec9e96 req-a0bc9bdc-920a-48be-8961-d1998e032502 service nova] Unable to find a host for instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2. Dropping event network-vif-unplugged {{(pid=134546) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 12:53:53.646759 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-4c04fac6-b5c5-4652-8f67-871265ec9e96 req-a0bc9bdc-920a-48be-8961-d1998e032502 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037595 May 23 12:53:53.647810 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 416/816] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 23 12:53:53.855786 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-635d2827-18da-4a80-b4df-05be3055327e tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/os-volume_attachments/f905c7f7-8ba7-4a7f-ab48-4d6f048bf7dc" status: 202 len: 0 microversion: 2.20 time: 0.290136 May 23 12:53:53.856372 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 401/817] 10.222.0.45 () {60 vars in 1456 bytes} [Mon May 23 12:53:53 2022] DELETE /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/os-volume_attachments/f905c7f7-8ba7-4a7f-ab48-4d6f048bf7dc => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 12:53:53.911917 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7e87536e-7ead-4836-aa2b-ee3fb293329d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:53:53.912485 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7e87536e-7ead-4836-aa2b-ee3fb293329d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:53.918717 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e87536e-7ead-4836-aa2b-ee3fb293329d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:53.919228 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e87536e-7ead-4836-aa2b-ee3fb293329d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:53.919987 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e87536e-7ead-4836-aa2b-ee3fb293329d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:53.920418 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e87536e-7ead-4836-aa2b-ee3fb293329d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:54.005967 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7e87536e-7ead-4836-aa2b-ee3fb293329d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "POST /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/action" status: 202 len: 0 microversion: 2.20 time: 0.097702 May 23 12:53:54.007244 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 417/818] 10.222.0.45 () {62 vars in 1318 bytes} [Mon May 23 12:53:53 2022] POST /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 12:53:54.015794 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-fdc02ed0-afd5-43ce-b089-7ec585402550 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:54.016407 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-fdc02ed0-afd5-43ce-b089-7ec585402550 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:54.023882 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fdc02ed0-afd5-43ce-b089-7ec585402550 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:54.024332 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fdc02ed0-afd5-43ce-b089-7ec585402550 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:54.025110 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fdc02ed0-afd5-43ce-b089-7ec585402550 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:54.025577 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fdc02ed0-afd5-43ce-b089-7ec585402550 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:54.188191 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-fdc02ed0-afd5-43ce-b089-7ec585402550 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:54.196896 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-fdc02ed0-afd5-43ce-b089-7ec585402550 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:54.198526 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-fdc02ed0-afd5-43ce-b089-7ec585402550 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:54.199699 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-fdc02ed0-afd5-43ce-b089-7ec585402550 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1672 microversion: 2.20 time: 0.187908 May 23 12:53:54.200259 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 402/819] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:54 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:55.220091 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-387b0dac-ad04-4605-a215-6120a3e44f98 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:55.220786 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-387b0dac-ad04-4605-a215-6120a3e44f98 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:55.228702 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-387b0dac-ad04-4605-a215-6120a3e44f98 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:55.229194 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-387b0dac-ad04-4605-a215-6120a3e44f98 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:55.229933 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-387b0dac-ad04-4605-a215-6120a3e44f98 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:55.230499 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-387b0dac-ad04-4605-a215-6120a3e44f98 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:55.371416 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-387b0dac-ad04-4605-a215-6120a3e44f98 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:55.380163 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-387b0dac-ad04-4605-a215-6120a3e44f98 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:55.381874 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-387b0dac-ad04-4605-a215-6120a3e44f98 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:55.383033 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-387b0dac-ad04-4605-a215-6120a3e44f98 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.168197 May 23 12:53:55.383599 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 418/820] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:55 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:53:56.403483 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2e7e9848-6981-4d4d-9cc3-a51605e57f78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:56.404850 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2e7e9848-6981-4d4d-9cc3-a51605e57f78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:56.411977 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2e7e9848-6981-4d4d-9cc3-a51605e57f78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:56.413533 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2e7e9848-6981-4d4d-9cc3-a51605e57f78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:56.414311 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2e7e9848-6981-4d4d-9cc3-a51605e57f78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:56.414916 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2e7e9848-6981-4d4d-9cc3-a51605e57f78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:56.624764 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2e7e9848-6981-4d4d-9cc3-a51605e57f78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:56.648307 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2e7e9848-6981-4d4d-9cc3-a51605e57f78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:56.652909 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2e7e9848-6981-4d4d-9cc3-a51605e57f78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:56.661053 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2e7e9848-6981-4d4d-9cc3-a51605e57f78 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.263396 May 23 12:53:56.662132 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 403/821] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:56 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:57.682428 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-50c917b0-bbef-4d8b-82ba-02cce52319ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:57.683038 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-50c917b0-bbef-4d8b-82ba-02cce52319ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:57.690259 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50c917b0-bbef-4d8b-82ba-02cce52319ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:57.690705 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50c917b0-bbef-4d8b-82ba-02cce52319ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:57.691680 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50c917b0-bbef-4d8b-82ba-02cce52319ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:57.692115 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-50c917b0-bbef-4d8b-82ba-02cce52319ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:57.860314 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-50c917b0-bbef-4d8b-82ba-02cce52319ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:57.869351 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-50c917b0-bbef-4d8b-82ba-02cce52319ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:57.871109 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-50c917b0-bbef-4d8b-82ba-02cce52319ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:57.872308 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-50c917b0-bbef-4d8b-82ba-02cce52319ad tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.193896 May 23 12:53:57.873010 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 419/822] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:57 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:53:58.894219 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-341dba76-591a-4b8c-8fb1-7a3409e88623 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:53:58.894957 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-341dba76-591a-4b8c-8fb1-7a3409e88623 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:53:58.902385 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-341dba76-591a-4b8c-8fb1-7a3409e88623 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:58.902931 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-341dba76-591a-4b8c-8fb1-7a3409e88623 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:58.904145 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-341dba76-591a-4b8c-8fb1-7a3409e88623 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:53:58.904740 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-341dba76-591a-4b8c-8fb1-7a3409e88623 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:53:59.049349 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-341dba76-591a-4b8c-8fb1-7a3409e88623 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:59.057357 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-341dba76-591a-4b8c-8fb1-7a3409e88623 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:59.058864 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-341dba76-591a-4b8c-8fb1-7a3409e88623 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:53:59.060023 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-341dba76-591a-4b8c-8fb1-7a3409e88623 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.171543 May 23 12:53:59.060601 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 404/823] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:53:58 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:00.079031 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-9300743d-0954-4f57-961d-3120c7e6914a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:00.079658 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-9300743d-0954-4f57-961d-3120c7e6914a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:00.087086 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9300743d-0954-4f57-961d-3120c7e6914a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:00.087547 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9300743d-0954-4f57-961d-3120c7e6914a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:00.088328 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9300743d-0954-4f57-961d-3120c7e6914a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:00.088779 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-9300743d-0954-4f57-961d-3120c7e6914a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:00.237408 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9300743d-0954-4f57-961d-3120c7e6914a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:00.245665 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9300743d-0954-4f57-961d-3120c7e6914a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:00.247151 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-9300743d-0954-4f57-961d-3120c7e6914a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:00.248327 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-9300743d-0954-4f57-961d-3120c7e6914a tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.173247 May 23 12:54:00.248880 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 420/824] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:00 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:01.267999 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e616c78e-e4aa-4024-8795-8fd984d51b5c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:01.268598 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e616c78e-e4aa-4024-8795-8fd984d51b5c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:01.276340 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e616c78e-e4aa-4024-8795-8fd984d51b5c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:01.276788 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e616c78e-e4aa-4024-8795-8fd984d51b5c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:01.277588 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e616c78e-e4aa-4024-8795-8fd984d51b5c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:01.278027 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e616c78e-e4aa-4024-8795-8fd984d51b5c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:01.432783 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e616c78e-e4aa-4024-8795-8fd984d51b5c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:01.440812 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e616c78e-e4aa-4024-8795-8fd984d51b5c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:01.442345 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e616c78e-e4aa-4024-8795-8fd984d51b5c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:01.443506 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e616c78e-e4aa-4024-8795-8fd984d51b5c tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.179495 May 23 12:54:01.444190 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 405/825] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:01 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:02.463564 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e2bb1653-f122-4f31-9a9f-267f851cdf66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:02.464202 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e2bb1653-f122-4f31-9a9f-267f851cdf66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:02.466740 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=50 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:02.471976 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e2bb1653-f122-4f31-9a9f-267f851cdf66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:02.472423 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e2bb1653-f122-4f31-9a9f-267f851cdf66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:02.473398 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e2bb1653-f122-4f31-9a9f-267f851cdf66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:02.473837 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e2bb1653-f122-4f31-9a9f-267f851cdf66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:02.614817 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e2bb1653-f122-4f31-9a9f-267f851cdf66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:02.623912 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e2bb1653-f122-4f31-9a9f-267f851cdf66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:02.625574 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e2bb1653-f122-4f31-9a9f-267f851cdf66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:02.626754 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e2bb1653-f122-4f31-9a9f-267f851cdf66 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.168151 May 23 12:54:02.627318 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 421/826] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:02 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:54:03.645652 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-da3842a6-f238-485c-911b-575eda8891d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:03.646494 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-da3842a6-f238-485c-911b-575eda8891d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:03.650322 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=44 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:03.662049 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-da3842a6-f238-485c-911b-575eda8891d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:03.663551 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-da3842a6-f238-485c-911b-575eda8891d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:03.664871 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-da3842a6-f238-485c-911b-575eda8891d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:03.665827 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-da3842a6-f238-485c-911b-575eda8891d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:03.833987 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-da3842a6-f238-485c-911b-575eda8891d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:03.843479 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-da3842a6-f238-485c-911b-575eda8891d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:03.845009 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-da3842a6-f238-485c-911b-575eda8891d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:03.846192 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-da3842a6-f238-485c-911b-575eda8891d6 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.204951 May 23 12:54:03.846743 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 406/827] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:03 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:04.864882 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-be16149c-7d4f-4d0f-b9e2-409f246b0e96 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:04.865569 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-be16149c-7d4f-4d0f-b9e2-409f246b0e96 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:04.873003 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-be16149c-7d4f-4d0f-b9e2-409f246b0e96 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:04.873413 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-be16149c-7d4f-4d0f-b9e2-409f246b0e96 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:04.874186 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-be16149c-7d4f-4d0f-b9e2-409f246b0e96 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:04.874620 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-be16149c-7d4f-4d0f-b9e2-409f246b0e96 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:05.009781 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-be16149c-7d4f-4d0f-b9e2-409f246b0e96 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:05.017896 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-be16149c-7d4f-4d0f-b9e2-409f246b0e96 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:05.019372 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-be16149c-7d4f-4d0f-b9e2-409f246b0e96 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:05.021231 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-be16149c-7d4f-4d0f-b9e2-409f246b0e96 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.161048 May 23 12:54:05.021903 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 422/828] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:04 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:06.040491 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-4b1cc1a9-a2a8-4459-94a6-94b55077b447 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:06.041092 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-4b1cc1a9-a2a8-4459-94a6-94b55077b447 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:06.047605 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b1cc1a9-a2a8-4459-94a6-94b55077b447 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:06.048042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b1cc1a9-a2a8-4459-94a6-94b55077b447 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:06.048792 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b1cc1a9-a2a8-4459-94a6-94b55077b447 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:06.049242 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-4b1cc1a9-a2a8-4459-94a6-94b55077b447 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:06.063628 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:06.180828 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-4b1cc1a9-a2a8-4459-94a6-94b55077b447 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:06.188670 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-4b1cc1a9-a2a8-4459-94a6-94b55077b447 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:06.190273 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-4b1cc1a9-a2a8-4459-94a6-94b55077b447 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:06.191434 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-4b1cc1a9-a2a8-4459-94a6-94b55077b447 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.155542 May 23 12:54:06.191986 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 407/829] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:06 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:07.210503 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5af0ee9f-b288-4e90-a486-d68c1a3203f7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:07.211104 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5af0ee9f-b288-4e90-a486-d68c1a3203f7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:07.218204 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5af0ee9f-b288-4e90-a486-d68c1a3203f7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:07.218690 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5af0ee9f-b288-4e90-a486-d68c1a3203f7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:07.219452 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5af0ee9f-b288-4e90-a486-d68c1a3203f7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:07.219881 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5af0ee9f-b288-4e90-a486-d68c1a3203f7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:07.347687 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5af0ee9f-b288-4e90-a486-d68c1a3203f7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:07.356287 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5af0ee9f-b288-4e90-a486-d68c1a3203f7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:07.357806 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5af0ee9f-b288-4e90-a486-d68c1a3203f7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:07.359025 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5af0ee9f-b288-4e90-a486-d68c1a3203f7 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.152919 May 23 12:54:07.359584 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 423/830] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:07 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:08.377937 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3c835519-6d27-4f39-9e48-53904e779caf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:08.379101 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3c835519-6d27-4f39-9e48-53904e779caf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:08.386118 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3c835519-6d27-4f39-9e48-53904e779caf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:08.386622 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3c835519-6d27-4f39-9e48-53904e779caf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:08.387335 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3c835519-6d27-4f39-9e48-53904e779caf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:08.387741 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3c835519-6d27-4f39-9e48-53904e779caf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:08.547479 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3c835519-6d27-4f39-9e48-53904e779caf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:08.565404 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3c835519-6d27-4f39-9e48-53904e779caf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:08.565404 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3c835519-6d27-4f39-9e48-53904e779caf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:08.565404 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3c835519-6d27-4f39-9e48-53904e779caf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.185156 May 23 12:54:08.566024 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 408/831] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:08 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:09.579496 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5444b374-1413-4547-8cba-670af48be442 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:09.580273 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5444b374-1413-4547-8cba-670af48be442 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:09.587891 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5444b374-1413-4547-8cba-670af48be442 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:09.588552 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5444b374-1413-4547-8cba-670af48be442 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:09.589378 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5444b374-1413-4547-8cba-670af48be442 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:09.589800 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5444b374-1413-4547-8cba-670af48be442 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:09.717407 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-fc6dc305-ad9e-4403-bf1c-32ea13968fff req-c8fc305f-0c31-418f-9b40-e2b48560d719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2", "name": "network-vif-plugged", "status": "completed", "tag": "09a5c406-d2e6-4886-a574-22f77e9b109c"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:54:09.729510 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-fc6dc305-ad9e-4403-bf1c-32ea13968fff req-c8fc305f-0c31-418f-9b40-e2b48560d719 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:09.730282 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-fc6dc305-ad9e-4403-bf1c-32ea13968fff req-c8fc305f-0c31-418f-9b40-e2b48560d719 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:09.735289 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5444b374-1413-4547-8cba-670af48be442 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:09.744590 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5444b374-1413-4547-8cba-670af48be442 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:09.746782 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5444b374-1413-4547-8cba-670af48be442 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:09.748033 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5444b374-1413-4547-8cba-670af48be442 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.172783 May 23 12:54:09.748813 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 424/832] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:09 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 12:54:09.761489 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-fc6dc305-ad9e-4403-bf1c-32ea13968fff req-c8fc305f-0c31-418f-9b40-e2b48560d719 service nova] Creating event network-vif-plugged:09a5c406-d2e6-4886-a574-22f77e9b109c for instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 on hv-cinder-maste May 23 12:54:09.767498 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-fc6dc305-ad9e-4403-bf1c-32ea13968fff req-c8fc305f-0c31-418f-9b40-e2b48560d719 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053957 May 23 12:54:09.769324 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 409/833] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:54:10.767129 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c63e0c70-595f-41cc-b179-18742da5db7b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:10.767701 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c63e0c70-595f-41cc-b179-18742da5db7b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:10.774548 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c63e0c70-595f-41cc-b179-18742da5db7b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:10.775216 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c63e0c70-595f-41cc-b179-18742da5db7b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:10.776011 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c63e0c70-595f-41cc-b179-18742da5db7b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:10.776444 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c63e0c70-595f-41cc-b179-18742da5db7b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:10.922330 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c63e0c70-595f-41cc-b179-18742da5db7b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:10.930829 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c63e0c70-595f-41cc-b179-18742da5db7b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:10.932479 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c63e0c70-595f-41cc-b179-18742da5db7b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:10.933755 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c63e0c70-595f-41cc-b179-18742da5db7b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.170639 May 23 12:54:10.934752 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 425/834] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:10 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:11.953652 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8c31c3d3-5026-4fd9-8b38-6ca39046f012 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:11.954369 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8c31c3d3-5026-4fd9-8b38-6ca39046f012 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:11.961862 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c31c3d3-5026-4fd9-8b38-6ca39046f012 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:11.962657 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c31c3d3-5026-4fd9-8b38-6ca39046f012 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:11.963982 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c31c3d3-5026-4fd9-8b38-6ca39046f012 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:11.964783 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c31c3d3-5026-4fd9-8b38-6ca39046f012 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:12.116005 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8c31c3d3-5026-4fd9-8b38-6ca39046f012 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:12.124922 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8c31c3d3-5026-4fd9-8b38-6ca39046f012 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:12.126530 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8c31c3d3-5026-4fd9-8b38-6ca39046f012 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:12.127764 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8c31c3d3-5026-4fd9-8b38-6ca39046f012 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1730 microversion: 2.20 time: 0.178909 May 23 12:54:12.128413 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 410/835] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:11 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:13.146997 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e5922002-274b-46de-baf4-8001c5c5c984 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:13.147510 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e5922002-274b-46de-baf4-8001c5c5c984 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:13.154430 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e5922002-274b-46de-baf4-8001c5c5c984 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:13.154865 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e5922002-274b-46de-baf4-8001c5c5c984 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:13.155619 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e5922002-274b-46de-baf4-8001c5c5c984 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:13.156041 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e5922002-274b-46de-baf4-8001c5c5c984 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:13.285690 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e5922002-274b-46de-baf4-8001c5c5c984 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:13.294067 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e5922002-274b-46de-baf4-8001c5c5c984 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:13.295551 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-e5922002-274b-46de-baf4-8001c5c5c984 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:13.296693 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e5922002-274b-46de-baf4-8001c5c5c984 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1717 microversion: 2.20 time: 0.153635 May 23 12:54:13.297290 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 426/836] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:13 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:20.317633 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8c1ebd50-0866-4063-8805-265be5b50d71 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:20.318223 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8c1ebd50-0866-4063-8805-265be5b50d71 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:20.324505 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c1ebd50-0866-4063-8805-265be5b50d71 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:20.324949 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c1ebd50-0866-4063-8805-265be5b50d71 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:20.325727 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c1ebd50-0866-4063-8805-265be5b50d71 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:20.326158 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8c1ebd50-0866-4063-8805-265be5b50d71 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:20.350283 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8c1ebd50-0866-4063-8805-265be5b50d71 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/ips" status: 200 len: 146 microversion: 2.1 time: 0.036680 May 23 12:54:20.350848 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 411/837] 10.222.0.45 () {58 vars in 1247 bytes} [Mon May 23 12:54:20 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:54:22.719957 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7e221f0e-ac4c-46fd-b131-e572bbe82a5f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1516d59a-92d9-41fa-b7d1-05c8790ad6a1"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:54:22.721060 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7e221f0e-ac4c-46fd-b131-e572bbe82a5f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:22.728461 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e221f0e-ac4c-46fd-b131-e572bbe82a5f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:22.728907 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e221f0e-ac4c-46fd-b131-e572bbe82a5f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:22.729689 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e221f0e-ac4c-46fd-b131-e572bbe82a5f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:22.730118 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7e221f0e-ac4c-46fd-b131-e572bbe82a5f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:22.957703 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:22.969612 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7e221f0e-ac4c-46fd-b131-e572bbe82a5f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253091 May 23 12:54:22.970218 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 427/838] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:54:22 2022] POST /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:54:24.141448 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2515f5a2-7f60-4e03-b71f-abdcfebd1b8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:54:24.150628 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2515f5a2-7f60-4e03-b71f-abdcfebd1b8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:24.151088 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2515f5a2-7f60-4e03-b71f-abdcfebd1b8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:24.212471 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2515f5a2-7f60-4e03-b71f-abdcfebd1b8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Going to try to stop instance {{(pid=134547) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 12:54:24.258109 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2515f5a2-7f60-4e03-b71f-abdcfebd1b8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/action" status: 202 len: 0 microversion: 2.1 time: 0.120527 May 23 12:54:24.258628 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 412/839] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:54:24 2022] POST /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:54:24.267775 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-cc9511c8-17ea-41d4-b55e-b7d0266df0f6 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:24.269044 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-cc9511c8-17ea-41d4-b55e-b7d0266df0f6 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:24.276401 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cc9511c8-17ea-41d4-b55e-b7d0266df0f6 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:24.276936 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cc9511c8-17ea-41d4-b55e-b7d0266df0f6 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:24.277842 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cc9511c8-17ea-41d4-b55e-b7d0266df0f6 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:24.278275 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-cc9511c8-17ea-41d4-b55e-b7d0266df0f6 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:24.432010 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-cc9511c8-17ea-41d4-b55e-b7d0266df0f6 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:24.440761 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-cc9511c8-17ea-41d4-b55e-b7d0266df0f6 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1725 microversion: 2.1 time: 0.177501 May 23 12:54:24.441363 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 428/840] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:24 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:25.458151 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-58fcc890-fd34-4433-97d5-b2daf283273a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:25.458812 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-58fcc890-fd34-4433-97d5-b2daf283273a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:25.465791 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-58fcc890-fd34-4433-97d5-b2daf283273a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:25.466236 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-58fcc890-fd34-4433-97d5-b2daf283273a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:25.466997 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-58fcc890-fd34-4433-97d5-b2daf283273a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:25.467414 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-58fcc890-fd34-4433-97d5-b2daf283273a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:25.607131 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-58fcc890-fd34-4433-97d5-b2daf283273a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:25.617524 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-58fcc890-fd34-4433-97d5-b2daf283273a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1725 microversion: 2.1 time: 0.163964 May 23 12:54:25.618106 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 413/841] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:25 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:26.636397 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8db64b85-9ae1-4be3-8dc8-8a5140bba7d4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:26.637169 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8db64b85-9ae1-4be3-8dc8-8a5140bba7d4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:26.643644 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8db64b85-9ae1-4be3-8dc8-8a5140bba7d4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:26.644086 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8db64b85-9ae1-4be3-8dc8-8a5140bba7d4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:26.644850 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8db64b85-9ae1-4be3-8dc8-8a5140bba7d4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:26.645316 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8db64b85-9ae1-4be3-8dc8-8a5140bba7d4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:26.783811 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8db64b85-9ae1-4be3-8dc8-8a5140bba7d4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:26.793557 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8db64b85-9ae1-4be3-8dc8-8a5140bba7d4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1725 microversion: 2.1 time: 0.161385 May 23 12:54:26.794138 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 429/842] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:26 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:27.811412 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8dd848f6-73f7-49b8-a987-457c9dba8229 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:27.812021 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8dd848f6-73f7-49b8-a987-457c9dba8229 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:27.818851 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8dd848f6-73f7-49b8-a987-457c9dba8229 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:27.819301 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8dd848f6-73f7-49b8-a987-457c9dba8229 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:27.820065 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8dd848f6-73f7-49b8-a987-457c9dba8229 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:27.820493 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8dd848f6-73f7-49b8-a987-457c9dba8229 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:27.954237 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8dd848f6-73f7-49b8-a987-457c9dba8229 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:27.962425 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8dd848f6-73f7-49b8-a987-457c9dba8229 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1725 microversion: 2.1 time: 0.155365 May 23 12:54:27.962991 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 414/843] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:27 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:28.979431 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ac7fce95-8062-4909-99b5-2e46e1b83c22 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:28.980739 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ac7fce95-8062-4909-99b5-2e46e1b83c22 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:28.987371 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac7fce95-8062-4909-99b5-2e46e1b83c22 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:28.987811 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac7fce95-8062-4909-99b5-2e46e1b83c22 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:28.988564 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac7fce95-8062-4909-99b5-2e46e1b83c22 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:28.988993 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac7fce95-8062-4909-99b5-2e46e1b83c22 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:29.124056 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ac7fce95-8062-4909-99b5-2e46e1b83c22 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:29.131873 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ac7fce95-8062-4909-99b5-2e46e1b83c22 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1725 microversion: 2.1 time: 0.156234 May 23 12:54:29.132445 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 430/844] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:28 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:30.149755 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f99b08d6-8669-4580-a918-1b9ccdad8302 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:30.150286 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f99b08d6-8669-4580-a918-1b9ccdad8302 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:30.156883 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f99b08d6-8669-4580-a918-1b9ccdad8302 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:30.157349 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f99b08d6-8669-4580-a918-1b9ccdad8302 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:30.158096 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f99b08d6-8669-4580-a918-1b9ccdad8302 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:30.158526 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f99b08d6-8669-4580-a918-1b9ccdad8302 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:30.288674 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f99b08d6-8669-4580-a918-1b9ccdad8302 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:30.297514 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f99b08d6-8669-4580-a918-1b9ccdad8302 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1725 microversion: 2.1 time: 0.151774 May 23 12:54:30.298078 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 415/845] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:30 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:31.314528 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-4114f420-b348-4749-b25b-f853e6acaaea tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:31.315135 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-4114f420-b348-4749-b25b-f853e6acaaea tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:31.321767 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4114f420-b348-4749-b25b-f853e6acaaea tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:31.322214 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4114f420-b348-4749-b25b-f853e6acaaea tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:31.322990 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4114f420-b348-4749-b25b-f853e6acaaea tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:31.323461 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-4114f420-b348-4749-b25b-f853e6acaaea tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:31.452834 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-4114f420-b348-4749-b25b-f853e6acaaea tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:31.460711 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-4114f420-b348-4749-b25b-f853e6acaaea tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1725 microversion: 2.1 time: 0.150028 May 23 12:54:31.461548 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 431/846] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:31 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:32.478181 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-73d2d8f4-4efa-4c6c-8cd3-266dc8483238 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:32.478788 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-73d2d8f4-4efa-4c6c-8cd3-266dc8483238 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:32.486063 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-73d2d8f4-4efa-4c6c-8cd3-266dc8483238 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:32.486512 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-73d2d8f4-4efa-4c6c-8cd3-266dc8483238 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:32.487271 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-73d2d8f4-4efa-4c6c-8cd3-266dc8483238 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:32.487706 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-73d2d8f4-4efa-4c6c-8cd3-266dc8483238 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:32.615014 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-73d2d8f4-4efa-4c6c-8cd3-266dc8483238 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:32.623315 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-73d2d8f4-4efa-4c6c-8cd3-266dc8483238 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1725 microversion: 2.1 time: 0.149040 May 23 12:54:32.623889 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 416/847] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:32 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:54:33.641018 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-a2a729b4-30f9-4ad5-9a68-ed47df6ea46a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:33.641567 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-a2a729b4-30f9-4ad5-9a68-ed47df6ea46a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:33.643951 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=22 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:33.649328 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a2a729b4-30f9-4ad5-9a68-ed47df6ea46a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:33.649772 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a2a729b4-30f9-4ad5-9a68-ed47df6ea46a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:33.650526 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a2a729b4-30f9-4ad5-9a68-ed47df6ea46a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:33.650955 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-a2a729b4-30f9-4ad5-9a68-ed47df6ea46a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:33.780223 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-a2a729b4-30f9-4ad5-9a68-ed47df6ea46a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:33.788475 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-a2a729b4-30f9-4ad5-9a68-ed47df6ea46a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1725 microversion: 2.1 time: 0.151305 May 23 12:54:33.789044 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 432/848] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:33 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:34.806377 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-bf91d4ef-d62f-4cdf-acfd-41a37c7937f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:34.807081 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-bf91d4ef-d62f-4cdf-acfd-41a37c7937f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:34.810362 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=22 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:34.815697 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bf91d4ef-d62f-4cdf-acfd-41a37c7937f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:34.816147 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bf91d4ef-d62f-4cdf-acfd-41a37c7937f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:34.816934 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bf91d4ef-d62f-4cdf-acfd-41a37c7937f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:34.817399 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-bf91d4ef-d62f-4cdf-acfd-41a37c7937f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:34.950297 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-bf91d4ef-d62f-4cdf-acfd-41a37c7937f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:34.958188 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-bf91d4ef-d62f-4cdf-acfd-41a37c7937f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1702 microversion: 2.1 time: 0.155702 May 23 12:54:34.958753 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 417/849] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:34 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1702 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:34.975857 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8af74cc4-03aa-4a62-906c-15ef02ebe53c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:54:34.982877 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8af74cc4-03aa-4a62-906c-15ef02ebe53c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:34.983317 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8af74cc4-03aa-4a62-906c-15ef02ebe53c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:35.042335 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8af74cc4-03aa-4a62-906c-15ef02ebe53c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Going to try to start instance {{(pid=134546) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 12:54:35.085590 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8af74cc4-03aa-4a62-906c-15ef02ebe53c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/action" status: 202 len: 0 microversion: 2.1 time: 0.113729 May 23 12:54:35.086370 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 433/850] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:54:34 2022] POST /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:54:35.095149 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-80606e84-ad14-469e-9645-959b76e40e8f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:35.095759 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-80606e84-ad14-469e-9645-959b76e40e8f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:35.101703 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-80606e84-ad14-469e-9645-959b76e40e8f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:35.102149 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-80606e84-ad14-469e-9645-959b76e40e8f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:35.102910 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-80606e84-ad14-469e-9645-959b76e40e8f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:35.103343 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-80606e84-ad14-469e-9645-959b76e40e8f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:35.271499 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-80606e84-ad14-469e-9645-959b76e40e8f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:35.280111 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-80606e84-ad14-469e-9645-959b76e40e8f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1711 microversion: 2.1 time: 0.188763 May 23 12:54:35.280694 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 418/851] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:35 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1711 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:54:36.299418 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2c58dcec-fe3c-4b41-9a28-dd6e3ae7c9f5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:36.300017 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2c58dcec-fe3c-4b41-9a28-dd6e3ae7c9f5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:36.306162 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2c58dcec-fe3c-4b41-9a28-dd6e3ae7c9f5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:36.306606 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2c58dcec-fe3c-4b41-9a28-dd6e3ae7c9f5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:36.307354 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2c58dcec-fe3c-4b41-9a28-dd6e3ae7c9f5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:36.307783 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2c58dcec-fe3c-4b41-9a28-dd6e3ae7c9f5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:36.593875 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2c58dcec-fe3c-4b41-9a28-dd6e3ae7c9f5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:36.601657 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2c58dcec-fe3c-4b41-9a28-dd6e3ae7c9f5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1711 microversion: 2.1 time: 0.307039 May 23 12:54:36.602217 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 434/852] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:36 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1711 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:37.618672 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3b1499e3-fde8-4b73-9e63-207ac2d2777d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:37.619224 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3b1499e3-fde8-4b73-9e63-207ac2d2777d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:37.626275 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3b1499e3-fde8-4b73-9e63-207ac2d2777d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:37.626722 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3b1499e3-fde8-4b73-9e63-207ac2d2777d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:37.627476 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3b1499e3-fde8-4b73-9e63-207ac2d2777d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:37.627908 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3b1499e3-fde8-4b73-9e63-207ac2d2777d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:37.630443 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:54:37.756160 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3b1499e3-fde8-4b73-9e63-207ac2d2777d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:37.764131 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3b1499e3-fde8-4b73-9e63-207ac2d2777d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1715 microversion: 2.1 time: 0.149385 May 23 12:54:37.764698 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 419/853] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:54:37 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:42.261671 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ea1b47e4-a358-49c2-b9a2-25bf11bef56b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:42.262638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ea1b47e4-a358-49c2-b9a2-25bf11bef56b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:42.269022 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ea1b47e4-a358-49c2-b9a2-25bf11bef56b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:42.269494 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ea1b47e4-a358-49c2-b9a2-25bf11bef56b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:42.270246 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ea1b47e4-a358-49c2-b9a2-25bf11bef56b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:42.270672 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ea1b47e4-a358-49c2-b9a2-25bf11bef56b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:42.298921 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ea1b47e4-a358-49c2-b9a2-25bf11bef56b tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041843 May 23 12:54:42.299448 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 435/854] 10.222.0.45 () {60 vars in 1342 bytes} [Mon May 23 12:54:42 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:54:42.357803 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3c710a4e-dfb9-444a-a469-8a5646f353d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:42.358303 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3c710a4e-dfb9-444a-a469-8a5646f353d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:42.364624 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3c710a4e-dfb9-444a-a469-8a5646f353d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:42.365068 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3c710a4e-dfb9-444a-a469-8a5646f353d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:42.365847 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3c710a4e-dfb9-444a-a469-8a5646f353d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:42.366283 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3c710a4e-dfb9-444a-a469-8a5646f353d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:42.391083 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3c710a4e-dfb9-444a-a469-8a5646f353d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Going to try to terminate instance {{(pid=134547) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:54:42.469746 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3c710a4e-dfb9-444a-a469-8a5646f353d2 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 204 len: 0 microversion: 2.20 time: 0.115334 May 23 12:54:42.473352 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 420/855] 10.222.0.45 () {60 vars in 1279 bytes} [Mon May 23 12:54:42 2022] DELETE /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 12:54:42.478622 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5e8bcfb2-cc42-4e31-8508-81ac6462b93d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:42.479386 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5e8bcfb2-cc42-4e31-8508-81ac6462b93d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:42.485927 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5e8bcfb2-cc42-4e31-8508-81ac6462b93d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:42.486373 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5e8bcfb2-cc42-4e31-8508-81ac6462b93d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:42.487135 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5e8bcfb2-cc42-4e31-8508-81ac6462b93d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:42.487565 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5e8bcfb2-cc42-4e31-8508-81ac6462b93d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:42.617945 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5e8bcfb2-cc42-4e31-8508-81ac6462b93d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:42.626677 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5e8bcfb2-cc42-4e31-8508-81ac6462b93d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:42.628176 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5e8bcfb2-cc42-4e31-8508-81ac6462b93d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:42.629365 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5e8bcfb2-cc42-4e31-8508-81ac6462b93d tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.154623 May 23 12:54:42.629987 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 436/856] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:42 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:43.649661 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d41275a6-8b3f-4216-8281-f932df756b29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:43.650345 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d41275a6-8b3f-4216-8281-f932df756b29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:43.657866 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d41275a6-8b3f-4216-8281-f932df756b29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:43.658308 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d41275a6-8b3f-4216-8281-f932df756b29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:43.659063 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d41275a6-8b3f-4216-8281-f932df756b29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:43.659491 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d41275a6-8b3f-4216-8281-f932df756b29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:43.791042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d41275a6-8b3f-4216-8281-f932df756b29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:43.799453 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d41275a6-8b3f-4216-8281-f932df756b29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:43.800939 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d41275a6-8b3f-4216-8281-f932df756b29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:43.802122 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d41275a6-8b3f-4216-8281-f932df756b29 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1723 microversion: 2.20 time: 0.156773 May 23 12:54:43.802688 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 421/857] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:43 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:44.661585 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-d4783201-6717-4415-a5a0-9e3cbafd6b55 req-b03bc0ab-5e10-4a06-a25b-8cc47776781c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2", "name": "network-vif-deleted", "tag": "09a5c406-d2e6-4886-a574-22f77e9b109c"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:54:44.672847 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-d4783201-6717-4415-a5a0-9e3cbafd6b55 req-b03bc0ab-5e10-4a06-a25b-8cc47776781c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:44.673322 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-d4783201-6717-4415-a5a0-9e3cbafd6b55 req-b03bc0ab-5e10-4a06-a25b-8cc47776781c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:44.685610 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-d4783201-6717-4415-a5a0-9e3cbafd6b55 req-b03bc0ab-5e10-4a06-a25b-8cc47776781c service nova] Creating event network-vif-deleted:09a5c406-d2e6-4886-a574-22f77e9b109c for instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 on hv-cinder-maste May 23 12:54:44.692301 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-d4783201-6717-4415-a5a0-9e3cbafd6b55 req-b03bc0ab-5e10-4a06-a25b-8cc47776781c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034680 May 23 12:54:44.692888 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 437/858] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:54:44.820311 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:44.821538 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:44.829036 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:44.829694 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:44.830659 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:44.831342 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:44.874130 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:44.874821 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:44.875272 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.objects.instance [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lazy-loading 'fault' on Instance uuid f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 {{(pid=134547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:54:44.917970 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:44.926423 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:44.928021 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd23ca857b76540ce83053424b710697b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6700b35745e4290b820f91719b249d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:54:44.929291 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7720b8f0-0fdf-4dc8-9fcc-34c1d5af1062 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 200 len: 1371 microversion: 2.20 time: 0.112891 May 23 12:54:44.930057 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 422/859] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:44 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 12:54:45.949820 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ad4b19bd-9ab8-4f9c-a4ad-70f49e335f00 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:45.950449 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ad4b19bd-9ab8-4f9c-a4ad-70f49e335f00 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:45.957176 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ad4b19bd-9ab8-4f9c-a4ad-70f49e335f00 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:45.957617 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ad4b19bd-9ab8-4f9c-a4ad-70f49e335f00 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:45.958369 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ad4b19bd-9ab8-4f9c-a4ad-70f49e335f00 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:45.958793 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ad4b19bd-9ab8-4f9c-a4ad-70f49e335f00 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:45.974444 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-ad4b19bd-9ab8-4f9c-a4ad-70f49e335f00 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] HTTP exception thrown: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ad4b19bd-9ab8-4f9c-a4ad-70f49e335f00 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Request method failure captured: May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 HTTP/1.1 May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J95yar1cPKmYO1burD_q_qz0QUWRFgZS2po2rlk5IQ4Qiyh4Ci327SEkX6d2x9eRq_q7JhKUl3nlbpC9s-ZF5WElZUnvRwtCwpqvEyuKDjqZYcQtMIU7mOiqg87opy5DnoYGyD30TcIKSzdqRZRqdBNiuIROENrVtgpGYIRtGm7ik May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: d6700b35745e4290b820f91719b249d4 May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:54:45.976062 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d6700b35745e4290b820f91719b249d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d6700b35745e4290b820f91719b249d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: d6700b35745e4290b820f91719b249d4 May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d23ca857b76540ce83053424b710697b May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:45.977751 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2'} May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:54:45.978817 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:45.980503 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:45.981970 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ad4b19bd-9ab8-4f9c-a4ad-70f49e335f00 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Returning 404 to user: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:54:45.981970 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ad4b19bd-9ab8-4f9c-a4ad-70f49e335f00 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 404 len: 111 microversion: 2.20 time: 0.032737 May 23 12:54:45.981970 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 438/860] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:45 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:54:45.986532 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f9a984e5-8540-4e8b-8bfa-c857558aeeb0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '.version_select at 0x7f6a377e9d30>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:46.002897 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f9a984e5-8540-4e8b-8bfa-c857558aeeb0 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426581192" status: 204 len: 0 microversion: 2.20 time: 0.020185 May 23 12:54:46.003436 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 423/861] 10.222.0.45 () {60 vars in 1261 bytes} [Mon May 23 12:54:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426581192 => generated 0 bytes in 21 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 12:54:47.741638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d8e54f29-3439-4081-b24a-8c74ee7f31e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:47.742130 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d8e54f29-3439-4081-b24a-8c74ee7f31e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:47.748614 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d8e54f29-3439-4081-b24a-8c74ee7f31e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:47.749050 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d8e54f29-3439-4081-b24a-8c74ee7f31e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:47.749823 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d8e54f29-3439-4081-b24a-8c74ee7f31e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:47.750244 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d8e54f29-3439-4081-b24a-8c74ee7f31e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:47.763483 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-d8e54f29-3439-4081-b24a-8c74ee7f31e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] HTTP exception thrown: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d8e54f29-3439-4081-b24a-8c74ee7f31e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Request method failure captured: May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: DELETE /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 HTTP/1.1 May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J95yar1cPKmYO1burD_q_qz0QUWRFgZS2po2rlk5IQ4Qiyh4Ci327SEkX6d2x9eRq_q7JhKUl3nlbpC9s-ZF5WElZUnvRwtCwpqvEyuKDjqZYcQtMIU7mOiqg87opy5DnoYGyD30TcIKSzdqRZRqdBNiuIROENrVtgpGYIRtGm7ik May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: d6700b35745e4290b820f91719b249d4 May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:54:47.765017 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d6700b35745e4290b820f91719b249d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d6700b35745e4290b820f91719b249d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: d6700b35745e4290b820f91719b249d4 May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d23ca857b76540ce83053424b710697b May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:47.766654 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2'} May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:54:47.767703 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:47.768935 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:47.770727 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d8e54f29-3439-4081-b24a-8c74ee7f31e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Returning 404 to user: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:54:47.770727 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d8e54f29-3439-4081-b24a-8c74ee7f31e4 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 404 len: 111 microversion: 2.20 time: 0.028671 May 23 12:54:47.770727 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 439/862] 10.222.0.45 () {60 vars in 1279 bytes} [Mon May 23 12:54:47 2022] DELETE /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:54:47.775395 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-05f1d1fb-dfd1-4b87-bd14-adee3ef56267 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:47.776003 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-05f1d1fb-dfd1-4b87-bd14-adee3ef56267 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:47.783333 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-05f1d1fb-dfd1-4b87-bd14-adee3ef56267 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:47.783781 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-05f1d1fb-dfd1-4b87-bd14-adee3ef56267 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:47.784535 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-05f1d1fb-dfd1-4b87-bd14-adee3ef56267 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:47.784971 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-05f1d1fb-dfd1-4b87-bd14-adee3ef56267 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:47.798632 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-05f1d1fb-dfd1-4b87-bd14-adee3ef56267 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] HTTP exception thrown: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-05f1d1fb-dfd1-4b87-bd14-adee3ef56267 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Request method failure captured: May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 HTTP/1.1 May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4J95yar1cPKmYO1burD_q_qz0QUWRFgZS2po2rlk5IQ4Qiyh4Ci327SEkX6d2x9eRq_q7JhKUl3nlbpC9s-ZF5WElZUnvRwtCwpqvEyuKDjqZYcQtMIU7mOiqg87opy5DnoYGyD30TcIKSzdqRZRqdBNiuIROENrVtgpGYIRtGm7ik May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: d6700b35745e4290b820f91719b249d4 May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:54:47.800255 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d6700b35745e4290b820f91719b249d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d6700b35745e4290b820f91719b249d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: d6700b35745e4290b820f91719b249d4 May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: d23ca857b76540ce83053424b710697b May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:47.801883 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': 'f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2'} May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:54:47.802875 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. May 23 12:54:47.804063 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:47.805242 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-05f1d1fb-dfd1-4b87-bd14-adee3ef56267 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Returning 404 to user: Instance f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:54:47.805242 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-05f1d1fb-dfd1-4b87-bd14-adee3ef56267 tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2" status: 404 len: 111 microversion: 2.20 time: 0.030647 May 23 12:54:47.805242 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 424/863] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:47 2022] GET /compute/v2.1/servers/f1a2bfd0-0a00-43ff-8785-a4470b0b6ad2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:54:48.936577 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-971787c3-3ec1-4f5e-9a47-e4b5e6649d7f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:48.937512 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-971787c3-3ec1-4f5e-9a47-e4b5e6649d7f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:48.943435 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-971787c3-3ec1-4f5e-9a47-e4b5e6649d7f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:48.943875 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-971787c3-3ec1-4f5e-9a47-e4b5e6649d7f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:48.944632 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-971787c3-3ec1-4f5e-9a47-e4b5e6649d7f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:48.945058 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-971787c3-3ec1-4f5e-9a47-e4b5e6649d7f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:48.958830 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-971787c3-3ec1-4f5e-9a47-e4b5e6649d7f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] HTTP exception thrown: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-971787c3-3ec1-4f5e-9a47-e4b5e6649d7f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Request method failure captured: May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: DELETE /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 HTTP/1.1 May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4J95yar1cPKmYO1burD_q_qz0QUWRFgZS2po2rlk5IQ4Qiyh4Ci327SEkX6d2x9eRq_q7JhKUl3nlbpC9s-ZF5WElZUnvRwtCwpqvEyuKDjqZYcQtMIU7mOiqg87opy5DnoYGyD30TcIKSzdqRZRqdBNiuIROENrVtgpGYIRtGm7ik May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: d6700b35745e4290b820f91719b249d4 May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:54:48.960614 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d6700b35745e4290b820f91719b249d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d6700b35745e4290b820f91719b249d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: d6700b35745e4290b820f91719b249d4 May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d23ca857b76540ce83053424b710697b May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:54:48.962259 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': '0c365608-41a1-4663-b5e2-3481874a2325'} May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:54:48.963378 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:54:48.964789 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:48.966332 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-971787c3-3ec1-4f5e-9a47-e4b5e6649d7f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Returning 404 to user: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:54:48.966332 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-971787c3-3ec1-4f5e-9a47-e4b5e6649d7f tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 404 len: 111 microversion: 2.20 time: 0.029359 May 23 12:54:48.966332 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 440/864] 10.222.0.45 () {60 vars in 1279 bytes} [Mon May 23 12:54:48 2022] DELETE /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:54:48.971146 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9f6b78c1-8ea7-4196-ad50-44d4501429bf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:48.971751 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9f6b78c1-8ea7-4196-ad50-44d4501429bf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] [instance: 0c365608-41a1-4663-b5e2-3481874a2325] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:54:48.978113 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9f6b78c1-8ea7-4196-ad50-44d4501429bf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:48.978550 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9f6b78c1-8ea7-4196-ad50-44d4501429bf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:48.979342 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9f6b78c1-8ea7-4196-ad50-44d4501429bf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:54:48.979778 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9f6b78c1-8ea7-4196-ad50-44d4501429bf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:54:48.992754 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-9f6b78c1-8ea7-4196-ad50-44d4501429bf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] HTTP exception thrown: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9f6b78c1-8ea7-4196-ad50-44d4501429bf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Request method failure captured: May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 HTTP/1.1 May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4J95yar1cPKmYO1burD_q_qz0QUWRFgZS2po2rlk5IQ4Qiyh4Ci327SEkX6d2x9eRq_q7JhKUl3nlbpC9s-ZF5WElZUnvRwtCwpqvEyuKDjqZYcQtMIU7mOiqg87opy5DnoYGyD30TcIKSzdqRZRqdBNiuIROENrVtgpGYIRtGm7ik May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Openstack-Nova-Api-Version: 2.20 May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: d6700b35745e4290b820f91719b249d4 May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:54:48.994314 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d6700b35745e4290b820f91719b249d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6700b35745e4290b820f91719b249d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d6700b35745e4290b820f91719b249d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: d6700b35745e4290b820f91719b249d4 May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1567897778 May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: d23ca857b76540ce83053424b710697b May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1567897778-project May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:54:48.996100 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '0c365608-41a1-4663-b5e2-3481874a2325'} May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:54:48.997019 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. May 23 12:54:48.998258 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:48.999337 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9f6b78c1-8ea7-4196-ad50-44d4501429bf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] Returning 404 to user: Instance 0c365608-41a1-4663-b5e2-3481874a2325 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:54:48.999337 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9f6b78c1-8ea7-4196-ad50-44d4501429bf tempest-AttachVolumeShelveTestJSON-1567897778 tempest-AttachVolumeShelveTestJSON-1567897778-project] 10.222.0.45 "GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325" status: 404 len: 111 microversion: 2.20 time: 0.029039 May 23 12:54:48.999337 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 425/865] 10.222.0.45 () {60 vars in 1276 bytes} [Mon May 23 12:54:48 2022] GET /compute/v2.1/servers/0c365608-41a1-4663-b5e2-3481874a2325 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 12:54:53.310144 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-1c8fac16-3bea-4166-ac53-5ad1db2f140b tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Action: 'create', calling method: .version_select at 0x7f6a36be00d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-313720586"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:54:53.617766 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-1c8fac16-3bea-4166-ac53-5ad1db2f140b tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.438088 May 23 12:54:53.618376 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 441/866] 10.222.0.45 () {60 vars in 1154 bytes} [Mon May 23 12:54:53 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 440 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 12:54:53.629712 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7d76ad22-8b9d-430c-85ca-982f7b53d22d tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a375e01f0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:53.688207 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7d76ad22-8b9d-430c-85ca-982f7b53d22d tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767" status: 200 len: 344 microversion: 2.1 time: 0.062332 May 23 12:54:53.688773 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 426/867] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:54:53 2022] GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:54:54.701574 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7088c5a1-5425-49e6-8f28-6e183132bbfc tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a36be1f70>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:54.749338 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7088c5a1-5425-49e6-8f28-6e183132bbfc tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767" status: 200 len: 345 microversion: 2.1 time: 0.052507 May 23 12:54:54.749895 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 442/868] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:54:54 2022] GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:54:54.761261 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-09cd98f7-06b3-4afc-a3be-d9bd8b8f05e3 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Action: 'create', calling method: .version_select at 0x7f6a377e99d0>, body: {"snapshot": {"volume_id": "6eb873f0-178c-4f43-860b-ba29f61b0767", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-586373278"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:54:54.908327 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-09cd98f7-06b3-4afc-a3be-d9bd8b8f05e3 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.151338 May 23 12:54:54.909045 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 427/869] 10.222.0.45 () {60 vars in 1161 bytes} [Mon May 23 12:54:54 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:54:54.919091 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-cb0d03e6-7de0-4c49-a4ab-9c7334c2c381 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a36e48280>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:54.952493 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-cb0d03e6-7de0-4c49-a4ab-9c7334c2c381 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420" status: 200 len: 286 microversion: 2.1 time: 0.037590 May 23 12:54:54.952997 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 443/870] 10.222.0.45 () {58 vars in 1250 bytes} [Mon May 23 12:54:54 2022] GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:54:54.963796 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-69cae6f6-75ab-4251-9e22-62ed12fd2d05 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a376ecdc0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:54.992293 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-69cae6f6-75ab-4251-9e22-62ed12fd2d05 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032541 May 23 12:54:54.992845 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 428/871] 10.222.0.45 () {58 vars in 1139 bytes} [Mon May 23 12:54:54 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:54:55.003936 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-91467dcb-54ff-4940-89ad-4b852b8263a9 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a36bcda60>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:55.035202 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-91467dcb-54ff-4940-89ad-4b852b8263a9 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420" status: 200 len: 286 microversion: 2.1 time: 0.035121 May 23 12:54:55.035773 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 444/872] 10.222.0.45 () {58 vars in 1250 bytes} [Mon May 23 12:54:54 2022] GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:54:56.048284 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-c982a1e1-89e5-407a-abf9-8d86841bd953 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a377e90d0>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:56.076267 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-c982a1e1-89e5-407a-abf9-8d86841bd953 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420" status: 200 len: 287 microversion: 2.1 time: 0.032232 May 23 12:54:56.076848 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 429/873] 10.222.0.45 () {58 vars in 1250 bytes} [Mon May 23 12:54:56 2022] GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:54:56.087769 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b781cc19-f0fe-42e2-95f3-026018309590 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a3ff4edc0>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:56.145745 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b781cc19-f0fe-42e2-95f3-026018309590 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420" status: 202 len: 0 microversion: 2.1 time: 0.062416 May 23 12:54:56.146286 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 445/874] 10.222.0.45 () {58 vars in 1253 bytes} [Mon May 23 12:54:56 2022] DELETE /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:54:56.154996 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d3661f9c-1537-4408-bcd1-ec3c9a416eaf tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a377e9f70>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:56.185953 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d3661f9c-1537-4408-bcd1-ec3c9a416eaf tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420" status: 200 len: 286 microversion: 2.1 time: 0.035342 May 23 12:54:56.186519 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 430/875] 10.222.0.45 () {58 vars in 1250 bytes} [Mon May 23 12:54:56 2022] GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:54:57.198154 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-cc8453fb-08a5-4822-8eba-3c0f2869ecd1 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a36bcda60>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:57.224240 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-cc8453fb-08a5-4822-8eba-3c0f2869ecd1 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] HTTP exception thrown: Snapshot 63ff3797-33a1-4f4d-aed7-7a06f681c420 could not be found. May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-cc8453fb-08a5-4822-8eba-3c0f2869ecd1 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Request method failure captured: May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420 HTTP/1.1 May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4QdbMD5SEZtAlQVP84rKlenJCJPMjkxEW8_Bvq6ywiNpV03f-yb9a42jBo1fY64aWhG0RSfmZ0VhcL5sXYGn1qm0HOEqPxXvzbhK0UuHUHCSJIVAZQAoJKtEOkBJOmaWMED4llyQt4Li3kTxCA6FcxuFEXP0iVylzo6a9KSdyZRask May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: efb2264d1da04ebb993d51af25a79154 May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:54:57.231769 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_efb2264d1da04ebb993d51af25a79154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: efb2264d1da04ebb993d51af25a79154 May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesSnapshotsTestJSON-832315946-project May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 64ec07c3e34641608e34ac1515114dad May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesSnapshotsTestJSON-832315946-project May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Snapshot 63ff3797-33a1-4f4d-aed7-7a06f681c420 could not be found. May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': '63ff3797-33a1-4f4d-aed7-7a06f681c420'} May 23 12:54:57.233422 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 63ff3797-33a1-4f4d-aed7-7a06f681c420 could not be found. (HTTP 404) (Request-ID: req-9a4a287e-02d2-4061-bb33-ee631f8c9ae3) May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:57.234379 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:54:57.235765 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 63ff3797-33a1-4f4d-aed7-7a06f681c420 could not be found. May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 23 12:54:57.237609 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 63ff3797-33a1-4f4d-aed7-7a06f681c420 could not be found. May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 63ff3797-33a1-4f4d-aed7-7a06f681c420 could not be found. May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-cc8453fb-08a5-4822-8eba-3c0f2869ecd1 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Returning 404 to user: Snapshot 63ff3797-33a1-4f4d-aed7-7a06f681c420 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-cc8453fb-08a5-4822-8eba-3c0f2869ecd1 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420" status: 404 len: 111 microversion: 2.1 time: 0.039437 May 23 12:54:57.239145 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 446/876] 10.222.0.45 () {58 vars in 1250 bytes} [Mon May 23 12:54:57 2022] GET /compute/v2.1/os-snapshots/63ff3797-33a1-4f4d-aed7-7a06f681c420 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:54:57.242293 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1182c96a-41ed-4ca7-a86c-f0173425f9e8 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a37780a60>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:57.300820 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1182c96a-41ed-4ca7-a86c-f0173425f9e8 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767" status: 202 len: 0 microversion: 2.1 time: 0.062699 May 23 12:54:57.301435 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 431/877] 10.222.0.45 () {58 vars in 1247 bytes} [Mon May 23 12:54:57 2022] DELETE /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:54:57.309693 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6ea395b6-4792-4648-8737-3d52b1123a27 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a36be15e0>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:57.359459 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6ea395b6-4792-4648-8737-3d52b1123a27 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767" status: 200 len: 344 microversion: 2.1 time: 0.053681 May 23 12:54:57.360018 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 447/878] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:54:57 2022] GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:54:58.373621 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2aba22ff-12ae-4210-9c6b-0be093bb8009 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a37603310>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:58.400986 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-2aba22ff-12ae-4210-9c6b-0be093bb8009 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] HTTP exception thrown: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2aba22ff-12ae-4210-9c6b-0be093bb8009 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Request method failure captured: May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767 HTTP/1.1 May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4QdbMD5SEZtAlQVP84rKlenJCJPMjkxEW8_Bvq6ywiNpV03f-yb9a42jBo1fY64aWhG0RSfmZ0VhcL5sXYGn1qm0HOEqPxXvzbhK0UuHUHCSJIVAZQAoJKtEOkBJOmaWMED4llyQt4Li3kTxCA6FcxuFEXP0iVylzo6a9KSdyZRask May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: efb2264d1da04ebb993d51af25a79154 May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:54:58.409368 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_efb2264d1da04ebb993d51af25a79154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: efb2264d1da04ebb993d51af25a79154 May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-VolumesSnapshotsTestJSON-832315946-project May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: 64ec07c3e34641608e34ac1515114dad May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-VolumesSnapshotsTestJSON-832315946-project May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '6eb873f0-178c-4f43-860b-ba29f61b0767'} May 23 12:54:58.411002 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. (HTTP 404) (Request-ID: req-31256abe-ddf5-4689-aaae-a98c0bca1e92) May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:58.412243 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:54:58.413857 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 12:54:58.415255 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2aba22ff-12ae-4210-9c6b-0be093bb8009 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Returning 404 to user: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2aba22ff-12ae-4210-9c6b-0be093bb8009 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767" status: 404 len: 109 microversion: 2.1 time: 0.042485 May 23 12:54:58.416556 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 432/879] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:54:58 2022] GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:54:58.426201 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5ad28a8f-f044-4601-8844-b528344ad08f tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a3c147430>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:58.454237 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-5ad28a8f-f044-4601-8844-b528344ad08f tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] HTTP exception thrown: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5ad28a8f-f044-4601-8844-b528344ad08f tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Request method failure captured: May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: DELETE /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767 HTTP/1.1 May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4QdbMD5SEZtAlQVP84rKlenJCJPMjkxEW8_Bvq6ywiNpV03f-yb9a42jBo1fY64aWhG0RSfmZ0VhcL5sXYGn1qm0HOEqPxXvzbhK0UuHUHCSJIVAZQAoJKtEOkBJOmaWMED4llyQt4Li3kTxCA6FcxuFEXP0iVylzo6a9KSdyZRask May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: efb2264d1da04ebb993d51af25a79154 May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:54:58.456243 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_efb2264d1da04ebb993d51af25a79154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: efb2264d1da04ebb993d51af25a79154 May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-VolumesSnapshotsTestJSON-832315946-project May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: 64ec07c3e34641608e34ac1515114dad May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-VolumesSnapshotsTestJSON-832315946-project May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': '6eb873f0-178c-4f43-860b-ba29f61b0767'} May 23 12:54:58.457828 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. (HTTP 404) (Request-ID: req-ab570d66-07cf-4635-aca5-40febf237dbe) May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:58.458940 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 12:54:58.460604 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 12:54:58.462046 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5ad28a8f-f044-4601-8844-b528344ad08f tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Returning 404 to user: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5ad28a8f-f044-4601-8844-b528344ad08f tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767" status: 404 len: 109 microversion: 2.1 time: 0.035846 May 23 12:54:58.463440 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 448/880] 10.222.0.45 () {58 vars in 1247 bytes} [Mon May 23 12:54:58 2022] DELETE /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:54:58.466530 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f54480df-c5dd-4ec8-acf5-d0163c435aa0 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Calling method '.version_select at 0x7f6a375f1160>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:54:58.493198 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-f54480df-c5dd-4ec8-acf5-d0163c435aa0 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] HTTP exception thrown: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f54480df-c5dd-4ec8-acf5-d0163c435aa0 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Request method failure captured: May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767 HTTP/1.1 May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4QdbMD5SEZtAlQVP84rKlenJCJPMjkxEW8_Bvq6ywiNpV03f-yb9a42jBo1fY64aWhG0RSfmZ0VhcL5sXYGn1qm0HOEqPxXvzbhK0UuHUHCSJIVAZQAoJKtEOkBJOmaWMED4llyQt4Li3kTxCA6FcxuFEXP0iVylzo6a9KSdyZRask May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: efb2264d1da04ebb993d51af25a79154 May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:54:58.495148 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/efb2264d1da04ebb993d51af25a79154"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_efb2264d1da04ebb993d51af25a79154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: efb2264d1da04ebb993d51af25a79154 May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-832315946 May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-VolumesSnapshotsTestJSON-832315946-project May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: 64ec07c3e34641608e34ac1515114dad May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-VolumesSnapshotsTestJSON-832315946-project May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '6eb873f0-178c-4f43-860b-ba29f61b0767'} May 23 12:54:58.497380 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. (HTTP 404) (Request-ID: req-21ee496d-11d5-4f32-bc6b-13ec5f57d18f) May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:58.498320 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 12:54:58.499692 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 12:54:58.501007 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f54480df-c5dd-4ec8-acf5-d0163c435aa0 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] Returning 404 to user: Volume 6eb873f0-178c-4f43-860b-ba29f61b0767 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f54480df-c5dd-4ec8-acf5-d0163c435aa0 tempest-VolumesSnapshotsTestJSON-832315946 tempest-VolumesSnapshotsTestJSON-832315946-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767" status: 404 len: 109 microversion: 2.1 time: 0.034484 May 23 12:54:58.502399 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 433/881] 10.222.0.45 () {58 vars in 1244 bytes} [Mon May 23 12:54:58 2022] GET /compute/v2.1/os-volumes/6eb873f0-178c-4f43-860b-ba29f61b0767 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:55:10.688136 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=17 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:10.689205 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:10.695860 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8e1acca8-6b2f-44bb-b695-5b30af2d785a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:10.696339 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8e1acca8-6b2f-44bb-b695-5b30af2d785a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:10.703603 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8e1acca8-6b2f-44bb-b695-5b30af2d785a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:10.704125 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8e1acca8-6b2f-44bb-b695-5b30af2d785a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:10.705076 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8e1acca8-6b2f-44bb-b695-5b30af2d785a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:10.705577 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8e1acca8-6b2f-44bb-b695-5b30af2d785a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:10.793177 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-8e1acca8-6b2f-44bb-b695-5b30af2d785a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lazy-loading 'services' on Instance uuid 73540f41-a90c-4826-8a73-3883ce48a0d1 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:55:10.863651 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8e1acca8-6b2f-44bb-b695-5b30af2d785a tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "DELETE /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/os-volume_attachments/1516d59a-92d9-41fa-b7d1-05c8790ad6a1" status: 202 len: 0 microversion: 2.1 time: 0.176056 May 23 12:55:10.864244 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 449/882] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:55:10 2022] DELETE /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/os-volume_attachments/1516d59a-92d9-41fa-b7d1-05c8790ad6a1 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:55:11.983741 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:11.984498 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:11.990125 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0c8b83d8-54bf-4a9e-98df-f7c39badd28d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:55:11.998420 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0c8b83d8-54bf-4a9e-98df-f7c39badd28d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:11.998873 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0c8b83d8-54bf-4a9e-98df-f7c39badd28d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:12.021977 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0c8b83d8-54bf-4a9e-98df-f7c39badd28d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Going to try to stop instance {{(pid=134547) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 12:55:12.066493 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0c8b83d8-54bf-4a9e-98df-f7c39badd28d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/action" status: 202 len: 0 microversion: 2.1 time: 0.083315 May 23 12:55:12.067167 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 434/883] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:55:11 2022] POST /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:55:12.076617 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8b3e3c25-608f-4b24-a502-668d4140786d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:12.077332 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8b3e3c25-608f-4b24-a502-668d4140786d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:12.083635 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8b3e3c25-608f-4b24-a502-668d4140786d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:12.084164 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8b3e3c25-608f-4b24-a502-668d4140786d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:12.085771 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8b3e3c25-608f-4b24-a502-668d4140786d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:12.086202 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8b3e3c25-608f-4b24-a502-668d4140786d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:12.218268 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8b3e3c25-608f-4b24-a502-668d4140786d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:12.226512 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8b3e3c25-608f-4b24-a502-668d4140786d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1679 microversion: 2.1 time: 0.155004 May 23 12:55:12.227073 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 450/884] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:12 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:13.244834 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6ae308a6-a293-4079-a70c-862b52668e2f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:13.245671 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6ae308a6-a293-4079-a70c-862b52668e2f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:13.251872 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6ae308a6-a293-4079-a70c-862b52668e2f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:13.252323 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6ae308a6-a293-4079-a70c-862b52668e2f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:13.253090 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6ae308a6-a293-4079-a70c-862b52668e2f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:13.253557 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6ae308a6-a293-4079-a70c-862b52668e2f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:13.390142 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6ae308a6-a293-4079-a70c-862b52668e2f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:13.397749 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6ae308a6-a293-4079-a70c-862b52668e2f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1679 microversion: 2.1 time: 0.157810 May 23 12:55:13.398309 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 435/885] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:13 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:14.415045 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3e661ae5-da55-46a7-8476-6ca5f45e43ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:14.415647 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-3e661ae5-da55-46a7-8476-6ca5f45e43ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:14.422896 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3e661ae5-da55-46a7-8476-6ca5f45e43ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:14.423340 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3e661ae5-da55-46a7-8476-6ca5f45e43ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:14.424099 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3e661ae5-da55-46a7-8476-6ca5f45e43ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:14.424529 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-3e661ae5-da55-46a7-8476-6ca5f45e43ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:14.555675 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-3e661ae5-da55-46a7-8476-6ca5f45e43ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:14.563936 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3e661ae5-da55-46a7-8476-6ca5f45e43ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1679 microversion: 2.1 time: 0.152827 May 23 12:55:14.564498 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 451/886] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:14 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:15.581261 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d324f8cc-52ac-4bda-8ad6-31b9f3c7be36 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:15.582302 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d324f8cc-52ac-4bda-8ad6-31b9f3c7be36 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:15.592623 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d324f8cc-52ac-4bda-8ad6-31b9f3c7be36 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:15.593080 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d324f8cc-52ac-4bda-8ad6-31b9f3c7be36 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:15.593875 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d324f8cc-52ac-4bda-8ad6-31b9f3c7be36 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:15.594318 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d324f8cc-52ac-4bda-8ad6-31b9f3c7be36 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:15.724673 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-d324f8cc-52ac-4bda-8ad6-31b9f3c7be36 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:15.732122 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d324f8cc-52ac-4bda-8ad6-31b9f3c7be36 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1679 microversion: 2.1 time: 0.155324 May 23 12:55:15.732697 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 436/887] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:15 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:16.748692 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-ac58e318-c5b0-4d7e-bc51-02f57beaee4d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:16.749333 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-ac58e318-c5b0-4d7e-bc51-02f57beaee4d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:16.755737 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac58e318-c5b0-4d7e-bc51-02f57beaee4d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:16.756174 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac58e318-c5b0-4d7e-bc51-02f57beaee4d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:16.756935 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac58e318-c5b0-4d7e-bc51-02f57beaee4d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:16.757395 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-ac58e318-c5b0-4d7e-bc51-02f57beaee4d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:16.887667 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-ac58e318-c5b0-4d7e-bc51-02f57beaee4d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:16.895877 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-ac58e318-c5b0-4d7e-bc51-02f57beaee4d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1679 microversion: 2.1 time: 0.151055 May 23 12:55:16.896453 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 452/888] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:16 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:17.914288 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-5eff71f2-e20d-4b51-b36c-04cad9adbca1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:17.914978 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-5eff71f2-e20d-4b51-b36c-04cad9adbca1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:17.921167 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5eff71f2-e20d-4b51-b36c-04cad9adbca1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:17.921617 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5eff71f2-e20d-4b51-b36c-04cad9adbca1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:17.922370 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5eff71f2-e20d-4b51-b36c-04cad9adbca1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:17.922799 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-5eff71f2-e20d-4b51-b36c-04cad9adbca1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:18.053000 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-5eff71f2-e20d-4b51-b36c-04cad9adbca1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:18.061117 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-5eff71f2-e20d-4b51-b36c-04cad9adbca1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1679 microversion: 2.1 time: 0.150686 May 23 12:55:18.061802 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 437/889] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:17 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:19.078834 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-f5041f2a-49b1-481e-b046-92075d2b6414 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:19.079432 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-f5041f2a-49b1-481e-b046-92075d2b6414 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:19.086298 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5041f2a-49b1-481e-b046-92075d2b6414 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:19.086747 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5041f2a-49b1-481e-b046-92075d2b6414 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:19.087549 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5041f2a-49b1-481e-b046-92075d2b6414 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:19.087981 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-f5041f2a-49b1-481e-b046-92075d2b6414 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:19.222123 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-f5041f2a-49b1-481e-b046-92075d2b6414 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:19.229678 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-f5041f2a-49b1-481e-b046-92075d2b6414 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1679 microversion: 2.1 time: 0.155421 May 23 12:55:19.230243 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 453/890] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:19 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:20.246915 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6f2cbb63-7de2-4432-8aeb-1fac6552f1ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:20.247744 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-6f2cbb63-7de2-4432-8aeb-1fac6552f1ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:20.254264 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6f2cbb63-7de2-4432-8aeb-1fac6552f1ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:20.254731 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6f2cbb63-7de2-4432-8aeb-1fac6552f1ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:20.255492 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6f2cbb63-7de2-4432-8aeb-1fac6552f1ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:20.255924 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-6f2cbb63-7de2-4432-8aeb-1fac6552f1ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:20.400578 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-6f2cbb63-7de2-4432-8aeb-1fac6552f1ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:20.410937 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6f2cbb63-7de2-4432-8aeb-1fac6552f1ca tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1679 microversion: 2.1 time: 0.168000 May 23 12:55:20.412099 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 438/891] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:20 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:21.427964 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-0522caff-5cd3-44d2-996e-4cc575d3d037 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:21.429324 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-0522caff-5cd3-44d2-996e-4cc575d3d037 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:21.444813 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0522caff-5cd3-44d2-996e-4cc575d3d037 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:21.446721 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0522caff-5cd3-44d2-996e-4cc575d3d037 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:21.447705 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0522caff-5cd3-44d2-996e-4cc575d3d037 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:21.448365 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0522caff-5cd3-44d2-996e-4cc575d3d037 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:21.725615 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-0522caff-5cd3-44d2-996e-4cc575d3d037 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:21.754118 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-0522caff-5cd3-44d2-996e-4cc575d3d037 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1679 microversion: 2.1 time: 0.330078 May 23 12:55:21.755406 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 454/892] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:21 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:22.772076 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-8f0f8fd1-e774-48f8-8700-20568d359370 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:22.772837 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-8f0f8fd1-e774-48f8-8700-20568d359370 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:22.796047 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8f0f8fd1-e774-48f8-8700-20568d359370 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:22.796657 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8f0f8fd1-e774-48f8-8700-20568d359370 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:22.799842 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8f0f8fd1-e774-48f8-8700-20568d359370 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:22.800414 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-8f0f8fd1-e774-48f8-8700-20568d359370 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:22.962484 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-8f0f8fd1-e774-48f8-8700-20568d359370 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:22.970593 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-8f0f8fd1-e774-48f8-8700-20568d359370 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1656 microversion: 2.1 time: 0.202761 May 23 12:55:22.982455 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 439/893] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:22 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1656 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:22.987358 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6f154916-a2d4-443b-8e5b-daa496f69ad5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:55:22.994512 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6f154916-a2d4-443b-8e5b-daa496f69ad5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:22.994993 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6f154916-a2d4-443b-8e5b-daa496f69ad5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:23.019193 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6f154916-a2d4-443b-8e5b-daa496f69ad5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Going to try to start instance {{(pid=134546) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 12:55:23.077568 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6f154916-a2d4-443b-8e5b-daa496f69ad5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/action" status: 202 len: 0 microversion: 2.1 time: 0.093885 May 23 12:55:23.078168 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 455/894] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:55:22 2022] POST /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 12:55:23.089106 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-de95865c-6bfb-4447-8069-b8ed1b6033d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:23.091200 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-de95865c-6bfb-4447-8069-b8ed1b6033d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:23.105319 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-de95865c-6bfb-4447-8069-b8ed1b6033d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:23.105990 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-de95865c-6bfb-4447-8069-b8ed1b6033d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:23.106922 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-de95865c-6bfb-4447-8069-b8ed1b6033d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:23.108384 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-de95865c-6bfb-4447-8069-b8ed1b6033d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:23.408545 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-de95865c-6bfb-4447-8069-b8ed1b6033d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:23.423321 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-de95865c-6bfb-4447-8069-b8ed1b6033d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1665 microversion: 2.1 time: 0.340847 May 23 12:55:23.424512 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 440/895] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:23 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1665 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:24.443619 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-08b305c0-ec44-46df-99e3-b8a970fa7e1f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:24.444874 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-08b305c0-ec44-46df-99e3-b8a970fa7e1f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:24.453172 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-08b305c0-ec44-46df-99e3-b8a970fa7e1f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:24.453350 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-08b305c0-ec44-46df-99e3-b8a970fa7e1f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:24.454395 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-08b305c0-ec44-46df-99e3-b8a970fa7e1f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:24.454839 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-08b305c0-ec44-46df-99e3-b8a970fa7e1f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:24.644673 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-08b305c0-ec44-46df-99e3-b8a970fa7e1f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:24.655139 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-08b305c0-ec44-46df-99e3-b8a970fa7e1f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1665 microversion: 2.1 time: 0.216658 May 23 12:55:24.660999 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 456/896] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:24 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1665 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:25.678291 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ec762586-62dd-4760-9490-d56cf6697d57 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:25.679133 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ec762586-62dd-4760-9490-d56cf6697d57 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:25.686159 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ec762586-62dd-4760-9490-d56cf6697d57 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:25.686916 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ec762586-62dd-4760-9490-d56cf6697d57 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:25.687778 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ec762586-62dd-4760-9490-d56cf6697d57 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:25.688308 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ec762586-62dd-4760-9490-d56cf6697d57 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:25.927493 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ec762586-62dd-4760-9490-d56cf6697d57 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:25.937651 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ec762586-62dd-4760-9490-d56cf6697d57 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1669 microversion: 2.1 time: 0.263103 May 23 12:55:25.938230 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 441/897] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:25 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1669 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:28.938146 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-3ac28afd-821a-4de7-bfff-6d4fda8bf8c4 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Action: 'create', calling method: .version_select at 0x7f6a3fef0280>, body: {"keypair": {"name": "tempest-TestShelveInstance-290085865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFy1viDRLmIt1/3ZZ67WORQXUJgqgv9iKMByZB+o98p3FqkdFqqNgC+A8Bx/P9+34QXLYq2HIHRbVu+ALTOPtsxbBi/rNVJzYkqh1yPnlHRjtzi5Z9L0DcKhV2pNHdMxjg=="}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:55:28.954083 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-3ac28afd-821a-4de7-bfff-6d4fda8bf8c4 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Getting quotas for project 94433bdea4e24d44a468370a418f79ad. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:55:28.959399 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.quota [None req-3ac28afd-821a-4de7-bfff-6d4fda8bf8c4 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Getting quotas for user 3e5623694b884f8f94c38d40812563c7 and project 94433bdea4e24d44a468370a418f79ad. Resources: {'key_pairs'} {{(pid=134546) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:55:28.984500 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-3ac28afd-821a-4de7-bfff-6d4fda8bf8c4 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.268611 May 23 12:55:28.985111 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 457/898] 10.222.0.45 () {60 vars in 1158 bytes} [Mon May 23 12:55:28 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:55:44.030405 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1165258345", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-290085865", "security_groups": [{"name": "tempest-secgroup-smoke-1405964568"}], "networks": [{"uuid": "37705c80-4e10-4e38-94f5-727bf65bedde"}], "block_device_mapping_v2": [{"uuid": "04f03091-3a73-489c-847c-43d920cb0787", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:55:44.039221 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=16 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:44.039870 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:44.410448 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] validate_networks() for [('37705c80-4e10-4e38-94f5-727bf65bedde', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:55:44.770849 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:55:44.771277 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:55:44.771782 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:55:44.772427 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:55:44.773049 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:55:44.783190 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:44.783671 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:44.784478 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:44.784915 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:44.802736 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Getting quotas for project 94433bdea4e24d44a468370a418f79ad. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:55:44.806671 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Getting quotas for user 3e5623694b884f8f94c38d40812563c7 and project 94433bdea4e24d44a468370a418f79ad. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:55:44.866288 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:55:44.868808 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='04f03091-3a73-489c-847c-43d920cb0787',volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:55:44.994411 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [d23df310-9660-4017-af67-0b6f697627cc] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 12:55:46.003277 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO oslo.messaging._drivers.impl_rabbit [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [d23df310-9660-4017-af67-0b6f697627cc] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45212. May 23 12:55:46.007106 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9c10acfc-0941-4664-89ec-27dc36dd5e3e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.981121 May 23 12:55:46.007759 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 442/899] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:55:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:55:46.016544 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:46.017371 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=4 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:46.018145 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:46.022574 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-30263a32-eebd-4ecc-8086-a1bf62b88b73 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:46.023267 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-30263a32-eebd-4ecc-8086-a1bf62b88b73 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:46.080907 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-30263a32-eebd-4ecc-8086-a1bf62b88b73 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:46.087693 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-30263a32-eebd-4ecc-8086-a1bf62b88b73 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1088 microversion: 2.1 time: 0.072720 May 23 12:55:46.088247 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 458/900] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:46 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:47.106432 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a95b81c1-e2ac-4417-80ca-205145f4da58 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:47.107156 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a95b81c1-e2ac-4417-80ca-205145f4da58 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:47.159749 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a95b81c1-e2ac-4417-80ca-205145f4da58 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:47.166351 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a95b81c1-e2ac-4417-80ca-205145f4da58 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1088 microversion: 2.1 time: 0.064636 May 23 12:55:47.166923 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 443/901] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:47 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:48.184316 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-03be89b5-048e-4c6a-a643-c0f6a08aa6e8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:48.184939 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-03be89b5-048e-4c6a-a643-c0f6a08aa6e8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:48.243977 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-03be89b5-048e-4c6a-a643-c0f6a08aa6e8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:48.250813 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-03be89b5-048e-4c6a-a643-c0f6a08aa6e8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1088 microversion: 2.1 time: 0.071119 May 23 12:55:48.251369 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 459/902] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:48 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:49.268099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7be95777-3a17-4311-abef-912c0810c3e9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:49.268703 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7be95777-3a17-4311-abef-912c0810c3e9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:49.321735 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7be95777-3a17-4311-abef-912c0810c3e9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:49.332112 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7be95777-3a17-4311-abef-912c0810c3e9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1088 microversion: 2.1 time: 0.067685 May 23 12:55:49.336303 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 444/903] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:49 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:50.349590 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-2fb42e11-bcbe-4431-8056-e4fddb2dcb75 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:50.350196 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-2fb42e11-bcbe-4431-8056-e4fddb2dcb75 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:50.357348 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2fb42e11-bcbe-4431-8056-e4fddb2dcb75 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:50.357791 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2fb42e11-bcbe-4431-8056-e4fddb2dcb75 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:50.358547 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2fb42e11-bcbe-4431-8056-e4fddb2dcb75 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:50.358978 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-2fb42e11-bcbe-4431-8056-e4fddb2dcb75 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:50.419657 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-2fb42e11-bcbe-4431-8056-e4fddb2dcb75 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:50.427147 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-2fb42e11-bcbe-4431-8056-e4fddb2dcb75 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1138 microversion: 2.1 time: 0.081484 May 23 12:55:50.427910 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 460/904] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:50 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:51.444404 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-609b5a8a-636e-4bde-8c89-ac68b4cfadb9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:51.445843 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-609b5a8a-636e-4bde-8c89-ac68b4cfadb9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:51.453107 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-609b5a8a-636e-4bde-8c89-ac68b4cfadb9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:51.453517 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-609b5a8a-636e-4bde-8c89-ac68b4cfadb9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:51.454283 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-609b5a8a-636e-4bde-8c89-ac68b4cfadb9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:51.454717 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-609b5a8a-636e-4bde-8c89-ac68b4cfadb9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:51.525864 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-609b5a8a-636e-4bde-8c89-ac68b4cfadb9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:51.534316 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-609b5a8a-636e-4bde-8c89-ac68b4cfadb9 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1204 microversion: 2.1 time: 0.093773 May 23 12:55:51.535299 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 445/905] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:51 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1204 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:52.552881 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-101a1531-fbea-46ac-8826-53d028746fa2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:52.553482 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-101a1531-fbea-46ac-8826-53d028746fa2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:52.560021 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-101a1531-fbea-46ac-8826-53d028746fa2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:52.560463 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-101a1531-fbea-46ac-8826-53d028746fa2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:52.561262 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-101a1531-fbea-46ac-8826-53d028746fa2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:52.561694 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-101a1531-fbea-46ac-8826-53d028746fa2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:52.598980 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-38c67ca2-f137-421a-95ea-5bf99f266f6b req-a617b060-ab4a-4359-888c-7839bf36194d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff8f49d-1e9e-4ed2-891c-c88d71d981d3", "tag": "579aef13-40d4-479a-8fd1-2eda9210e83a"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:55:52.612282 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-38c67ca2-f137-421a-95ea-5bf99f266f6b req-a617b060-ab4a-4359-888c-7839bf36194d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:52.612984 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-38c67ca2-f137-421a-95ea-5bf99f266f6b req-a617b060-ab4a-4359-888c-7839bf36194d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:52.629866 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-38c67ca2-f137-421a-95ea-5bf99f266f6b req-a617b060-ab4a-4359-888c-7839bf36194d service nova] Creating event network-changed:579aef13-40d4-479a-8fd1-2eda9210e83a for instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 on hv-cinder-maste May 23 12:55:52.635190 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-38c67ca2-f137-421a-95ea-5bf99f266f6b req-a617b060-ab4a-4359-888c-7839bf36194d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039925 May 23 12:55:52.635789 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 446/906] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:55:52.733814 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-101a1531-fbea-46ac-8826-53d028746fa2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:52.742318 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-101a1531-fbea-46ac-8826-53d028746fa2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1260 microversion: 2.1 time: 0.194256 May 23 12:55:52.743392 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 461/907] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:52 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:53.761330 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2a256615-d4b8-4f74-8118-f7899e47fbad tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:53.762792 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2a256615-d4b8-4f74-8118-f7899e47fbad tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:53.769310 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2a256615-d4b8-4f74-8118-f7899e47fbad tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:53.769779 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2a256615-d4b8-4f74-8118-f7899e47fbad tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:53.770538 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2a256615-d4b8-4f74-8118-f7899e47fbad tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:53.770966 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2a256615-d4b8-4f74-8118-f7899e47fbad tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:53.986518 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2a256615-d4b8-4f74-8118-f7899e47fbad tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:53.994008 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2a256615-d4b8-4f74-8118-f7899e47fbad tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1260 microversion: 2.1 time: 0.237380 May 23 12:55:53.994582 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 447/908] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:53 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:55.011022 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-dda33752-4c71-4603-b6ee-f57b00487873 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:55.011683 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-dda33752-4c71-4603-b6ee-f57b00487873 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:55.017911 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dda33752-4c71-4603-b6ee-f57b00487873 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:55.018355 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dda33752-4c71-4603-b6ee-f57b00487873 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:55.019106 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dda33752-4c71-4603-b6ee-f57b00487873 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:55.019536 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-dda33752-4c71-4603-b6ee-f57b00487873 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:55.150307 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-dda33752-4c71-4603-b6ee-f57b00487873 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:55.158346 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-dda33752-4c71-4603-b6ee-f57b00487873 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1260 microversion: 2.1 time: 0.151205 May 23 12:55:55.158912 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 462/909] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:55 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:55:56.175123 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-cdc14ee3-feb5-4ff6-9dc6-af004199e7fc tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:56.175728 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-cdc14ee3-feb5-4ff6-9dc6-af004199e7fc tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:56.178435 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:56.183975 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cdc14ee3-feb5-4ff6-9dc6-af004199e7fc tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:56.184535 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cdc14ee3-feb5-4ff6-9dc6-af004199e7fc tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:56.185338 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cdc14ee3-feb5-4ff6-9dc6-af004199e7fc tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:56.185776 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-cdc14ee3-feb5-4ff6-9dc6-af004199e7fc tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:56.321677 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-cdc14ee3-feb5-4ff6-9dc6-af004199e7fc tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:56.330303 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-cdc14ee3-feb5-4ff6-9dc6-af004199e7fc tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1260 microversion: 2.1 time: 0.159036 May 23 12:55:56.340440 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 448/910] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:56 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:57.347701 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-726cafa7-f3cb-4cf6-9535-b6e79a587dd2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:57.348308 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-726cafa7-f3cb-4cf6-9535-b6e79a587dd2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:57.355011 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-726cafa7-f3cb-4cf6-9535-b6e79a587dd2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:57.355454 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-726cafa7-f3cb-4cf6-9535-b6e79a587dd2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:57.356271 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-726cafa7-f3cb-4cf6-9535-b6e79a587dd2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:57.356709 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-726cafa7-f3cb-4cf6-9535-b6e79a587dd2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:57.488365 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-726cafa7-f3cb-4cf6-9535-b6e79a587dd2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:57.495683 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-726cafa7-f3cb-4cf6-9535-b6e79a587dd2 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1260 microversion: 2.1 time: 0.151870 May 23 12:55:57.496237 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 463/911] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:57 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:58.302940 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-3e8d76de-5b4e-43d2-9712-5cac7b83fafa req-77e75d4b-cb3d-4629-ad30-336f4bb7f8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff8f49d-1e9e-4ed2-891c-c88d71d981d3", "name": "network-vif-plugged", "status": "completed", "tag": "579aef13-40d4-479a-8fd1-2eda9210e83a"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:55:58.312840 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-3e8d76de-5b4e-43d2-9712-5cac7b83fafa req-77e75d4b-cb3d-4629-ad30-336f4bb7f8ee service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:58.313275 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-3e8d76de-5b4e-43d2-9712-5cac7b83fafa req-77e75d4b-cb3d-4629-ad30-336f4bb7f8ee service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:58.324254 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-3e8d76de-5b4e-43d2-9712-5cac7b83fafa req-77e75d4b-cb3d-4629-ad30-336f4bb7f8ee service nova] Creating event network-vif-plugged:579aef13-40d4-479a-8fd1-2eda9210e83a for instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 on hv-cinder-maste May 23 12:55:58.333172 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-3e8d76de-5b4e-43d2-9712-5cac7b83fafa req-77e75d4b-cb3d-4629-ad30-336f4bb7f8ee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033904 May 23 12:55:58.334759 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 449/912] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:55:58.513558 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-fc150192-5b9d-4f68-9292-17d1ef40652b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:58.514152 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-fc150192-5b9d-4f68-9292-17d1ef40652b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:58.516063 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=4 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:55:58.522274 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fc150192-5b9d-4f68-9292-17d1ef40652b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:58.522729 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fc150192-5b9d-4f68-9292-17d1ef40652b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:58.523498 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fc150192-5b9d-4f68-9292-17d1ef40652b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:58.523929 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fc150192-5b9d-4f68-9292-17d1ef40652b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:58.661532 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fc150192-5b9d-4f68-9292-17d1ef40652b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:58.670095 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-fc150192-5b9d-4f68-9292-17d1ef40652b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1260 microversion: 2.1 time: 0.161088 May 23 12:55:58.670951 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 464/913] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:58 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:58.677092 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-1eba0b0c-fbc4-48cf-9fa4-766e4beccc8d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:58.678457 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-1eba0b0c-fbc4-48cf-9fa4-766e4beccc8d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:58.685766 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1eba0b0c-fbc4-48cf-9fa4-766e4beccc8d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:58.686521 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1eba0b0c-fbc4-48cf-9fa4-766e4beccc8d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:58.687529 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1eba0b0c-fbc4-48cf-9fa4-766e4beccc8d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:58.688202 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-1eba0b0c-fbc4-48cf-9fa4-766e4beccc8d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:58.716887 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-1eba0b0c-fbc4-48cf-9fa4-766e4beccc8d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044131 May 23 12:55:58.717484 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 450/914] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:55:58 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:55:58.774449 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-40a43ebf-56f9-403d-be6c-99ef766766f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:58.774886 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-40a43ebf-56f9-403d-be6c-99ef766766f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:58.780769 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-40a43ebf-56f9-403d-be6c-99ef766766f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:58.781252 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-40a43ebf-56f9-403d-be6c-99ef766766f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:58.782015 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-40a43ebf-56f9-403d-be6c-99ef766766f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:58.782451 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-40a43ebf-56f9-403d-be6c-99ef766766f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:58.807078 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-40a43ebf-56f9-403d-be6c-99ef766766f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Going to try to terminate instance {{(pid=134546) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:55:58.879101 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-40a43ebf-56f9-403d-be6c-99ef766766f9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "DELETE /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 204 len: 0 microversion: 2.1 time: 0.108317 May 23 12:55:58.879676 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 465/915] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:55:58 2022] DELETE /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:55:58.888734 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2c0adea9-f499-46bc-8e34-e0a609cd9226 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:58.889398 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2c0adea9-f499-46bc-8e34-e0a609cd9226 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:58.895837 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c0adea9-f499-46bc-8e34-e0a609cd9226 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:58.896285 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c0adea9-f499-46bc-8e34-e0a609cd9226 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:58.897678 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c0adea9-f499-46bc-8e34-e0a609cd9226 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:58.898132 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c0adea9-f499-46bc-8e34-e0a609cd9226 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:59.029423 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2c0adea9-f499-46bc-8e34-e0a609cd9226 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:59.036682 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2c0adea9-f499-46bc-8e34-e0a609cd9226 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1675 microversion: 2.1 time: 0.152786 May 23 12:55:59.037267 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 451/916] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:58 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:55:59.696675 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-0b5c3431-d101-4063-af90-61c69f857bd3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:55:59.697316 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-0b5c3431-d101-4063-af90-61c69f857bd3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:55:59.704376 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0b5c3431-d101-4063-af90-61c69f857bd3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:59.704838 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0b5c3431-d101-4063-af90-61c69f857bd3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:59.705610 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0b5c3431-d101-4063-af90-61c69f857bd3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:55:59.706044 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0b5c3431-d101-4063-af90-61c69f857bd3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:55:59.835823 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-0b5c3431-d101-4063-af90-61c69f857bd3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:55:59.843493 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-0b5c3431-d101-4063-af90-61c69f857bd3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1260 microversion: 2.1 time: 0.151212 May 23 12:55:59.844054 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 466/917] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:55:59 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:00.054858 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-66113a3a-c2ee-42e4-a214-ae0cd3b8f363 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:00.055445 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-66113a3a-c2ee-42e4-a214-ae0cd3b8f363 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:00.057803 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=10 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:00.064078 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-66113a3a-c2ee-42e4-a214-ae0cd3b8f363 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:00.064519 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-66113a3a-c2ee-42e4-a214-ae0cd3b8f363 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:00.065307 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-66113a3a-c2ee-42e4-a214-ae0cd3b8f363 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:00.065735 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-66113a3a-c2ee-42e4-a214-ae0cd3b8f363 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:00.195470 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-66113a3a-c2ee-42e4-a214-ae0cd3b8f363 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:00.203064 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-66113a3a-c2ee-42e4-a214-ae0cd3b8f363 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1675 microversion: 2.1 time: 0.152082 May 23 12:56:00.203633 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 452/918] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:00 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:00.863360 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-14ab22a3-38b1-4410-b2b3-2380bf2a5fa5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:00.863973 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-14ab22a3-38b1-4410-b2b3-2380bf2a5fa5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:00.870510 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-14ab22a3-38b1-4410-b2b3-2380bf2a5fa5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:00.870948 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-14ab22a3-38b1-4410-b2b3-2380bf2a5fa5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:00.871772 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-14ab22a3-38b1-4410-b2b3-2380bf2a5fa5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:00.872203 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-14ab22a3-38b1-4410-b2b3-2380bf2a5fa5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:01.016179 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-14ab22a3-38b1-4410-b2b3-2380bf2a5fa5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:01.023963 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-14ab22a3-38b1-4410-b2b3-2380bf2a5fa5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1260 microversion: 2.1 time: 0.167068 May 23 12:56:01.024542 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 467/919] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:00 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:01.220353 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-57b30488-a410-419b-bae9-cba579e0d6e5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:01.220992 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-57b30488-a410-419b-bae9-cba579e0d6e5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:01.228427 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-57b30488-a410-419b-bae9-cba579e0d6e5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:01.228987 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-57b30488-a410-419b-bae9-cba579e0d6e5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:01.229866 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-57b30488-a410-419b-bae9-cba579e0d6e5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:01.230300 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-57b30488-a410-419b-bae9-cba579e0d6e5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:01.362132 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-57b30488-a410-419b-bae9-cba579e0d6e5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:01.373798 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-57b30488-a410-419b-bae9-cba579e0d6e5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1675 microversion: 2.1 time: 0.156963 May 23 12:56:01.374832 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 453/920] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:01 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:02.040586 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5cffffb8-a177-47f2-a4ca-bf3d22b574d8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:02.041101 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5cffffb8-a177-47f2-a4ca-bf3d22b574d8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:02.047757 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5cffffb8-a177-47f2-a4ca-bf3d22b574d8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:02.048206 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5cffffb8-a177-47f2-a4ca-bf3d22b574d8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:02.048976 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5cffffb8-a177-47f2-a4ca-bf3d22b574d8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:02.049441 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5cffffb8-a177-47f2-a4ca-bf3d22b574d8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:02.192757 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5cffffb8-a177-47f2-a4ca-bf3d22b574d8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:02.200768 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5cffffb8-a177-47f2-a4ca-bf3d22b574d8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1444 microversion: 2.1 time: 0.164164 May 23 12:56:02.201742 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 468/921] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:02 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:56:02.218726 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-40192759-4032-4067-b278-5cdf6c61132f tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:02.219323 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-40192759-4032-4067-b278-5cdf6c61132f tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:02.227873 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-40192759-4032-4067-b278-5cdf6c61132f tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:02.228588 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-40192759-4032-4067-b278-5cdf6c61132f tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:02.229204 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-0964b24e-1f6a-4215-8f1c-4dc32005fd6f req-163514dd-f8e4-48c8-a219-05298d88c11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73540f41-a90c-4826-8a73-3883ce48a0d1", "name": "network-vif-deleted", "tag": "11784d14-fd57-43bb-bd2e-f74c6df1e123"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:56:02.229562 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-40192759-4032-4067-b278-5cdf6c61132f tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:02.230108 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-40192759-4032-4067-b278-5cdf6c61132f tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:02.240350 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-0964b24e-1f6a-4215-8f1c-4dc32005fd6f req-163514dd-f8e4-48c8-a219-05298d88c11a service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:02.241119 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-0964b24e-1f6a-4215-8f1c-4dc32005fd6f req-163514dd-f8e4-48c8-a219-05298d88c11a service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:02.269067 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-0964b24e-1f6a-4215-8f1c-4dc32005fd6f req-163514dd-f8e4-48c8-a219-05298d88c11a service nova] Creating event network-vif-deleted:11784d14-fd57-43bb-bd2e-f74c6df1e123 for instance 73540f41-a90c-4826-8a73-3883ce48a0d1 on hv-cinder-maste May 23 12:56:02.275431 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-0964b24e-1f6a-4215-8f1c-4dc32005fd6f req-163514dd-f8e4-48c8-a219-05298d88c11a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049987 May 23 12:56:02.276366 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 469/922] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:56:02.394576 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:02.396337 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:02.404028 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:02.404570 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:02.405466 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:02.406005 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:02.420533 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-40192759-4032-4067-b278-5cdf6c61132f tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:02.429630 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-40192759-4032-4067-b278-5cdf6c61132f tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1444 microversion: 2.1 time: 0.215492 May 23 12:56:02.430799 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 454/923] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:02 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1444 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:02.456754 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:02.457226 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:02.457685 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lazy-loading 'fault' on Instance uuid 73540f41-a90c-4826-8a73-3883ce48a0d1 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:56:02.504382 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:02.512025 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-10fd14c8-606e-4de0-a2fb-ca93edb074ad tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 200 len: 1328 microversion: 2.1 time: 0.121898 May 23 12:56:02.513946 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 470/924] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:02 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 1328 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:03.530797 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b0893247-eb59-4df4-b153-d30441e76add tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:03.531527 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-b0893247-eb59-4df4-b153-d30441e76add tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:03.538155 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b0893247-eb59-4df4-b153-d30441e76add tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:03.538603 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b0893247-eb59-4df4-b153-d30441e76add tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:03.539371 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b0893247-eb59-4df4-b153-d30441e76add tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:03.539808 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-b0893247-eb59-4df4-b153-d30441e76add tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:03.554460 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-b0893247-eb59-4df4-b153-d30441e76add tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] HTTP exception thrown: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b0893247-eb59-4df4-b153-d30441e76add tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Request method failure captured: May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 HTTP/1.1 May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4PHQkMmWeG5PNlc-ytG3ePou8qKHbru5hTFOO4o0rhccB6-CV1KyBFCIEoDGu1FsIGGBz_NQjPfLrQw6LqfFkzz0W0fzoKzmGiiOAiwbklXP5icIwUVPb7hqgER2wmEmHGWzWfPiI9jE5_Y_tbC1bVPrdggVYrKRbaeACOuWA86YZw May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:56:03.556213 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/18e2757f7e6644099af9e5510954a391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_18e2757f7e6644099af9e5510954a391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeTestJSON-2001540863 May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: d96f7e82915f4563b05c20c414c23229 May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:56:03.557731 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '73540f41-a90c-4826-8a73-3883ce48a0d1'} May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:56:03.558643 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:56:03.560068 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:56:03.561308 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-b0893247-eb59-4df4-b153-d30441e76add tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Returning 404 to user: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:56:03.561308 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-b0893247-eb59-4df4-b153-d30441e76add tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 404 len: 111 microversion: 2.1 time: 0.031551 May 23 12:56:03.561308 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 455/925] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:03 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:56:03.566762 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-48dec334-dcf0-4708-b23d-2b60ad080452 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '.version_select at 0x7f6a36be0ca0>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:03.584786 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-48dec334-dcf0-4708-b23d-2b60ad080452 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493961613" status: 202 len: 0 microversion: 2.1 time: 0.021645 May 23 12:56:03.585584 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 471/926] 10.222.0.45 () {58 vars in 1220 bytes} [Mon May 23 12:56:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493961613 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:56:04.205682 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-6c63e24d-dda5-455d-9211-f720db0c6d08 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'create', calling method: .version_select at 0x7f6a37659280>, body: {"keypair": {"name": "tempest-keypair-669137268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFI3Kywb0Uv8vqxEyKS16mWcv8XAimunZfYTT1lShWGeOZEa1j//c+wQDcVAQpvs88XaOa4CwmoiRwmQ4yhL6qMPFJONUpALAlvH96wzPmtfJB/Ic7QPnrvmean8i8nEQ=="}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:56:04.220130 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-6c63e24d-dda5-455d-9211-f720db0c6d08 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Getting quotas for project 18e2757f7e6644099af9e5510954a391. Resources: {'key_pairs'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:56:04.223785 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-6c63e24d-dda5-455d-9211-f720db0c6d08 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Getting quotas for user d96f7e82915f4563b05c20c414c23229 and project 18e2757f7e6644099af9e5510954a391. Resources: {'key_pairs'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:56:04.247670 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-6c63e24d-dda5-455d-9211-f720db0c6d08 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045237 May 23 12:56:04.248398 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 456/927] 10.222.0.45 () {60 vars in 1158 bytes} [Mon May 23 12:56:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:56:04.489397 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-6366f462-e7f9-4a47-970e-d7d80d47cd7d req-1a91dc94-ce9a-48f6-86db-221631dcb0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff8f49d-1e9e-4ed2-891c-c88d71d981d3", "tag": "579aef13-40d4-479a-8fd1-2eda9210e83a"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:56:04.497677 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-6366f462-e7f9-4a47-970e-d7d80d47cd7d req-1a91dc94-ce9a-48f6-86db-221631dcb0a6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:04.498130 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-6366f462-e7f9-4a47-970e-d7d80d47cd7d req-1a91dc94-ce9a-48f6-86db-221631dcb0a6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:04.509998 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-6366f462-e7f9-4a47-970e-d7d80d47cd7d req-1a91dc94-ce9a-48f6-86db-221631dcb0a6 service nova] Creating event network-changed:579aef13-40d4-479a-8fd1-2eda9210e83a for instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 on hv-cinder-maste May 23 12:56:04.516368 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-6366f462-e7f9-4a47-970e-d7d80d47cd7d req-1a91dc94-ce9a-48f6-86db-221631dcb0a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030481 May 23 12:56:04.516973 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 472/928] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:56:06.132151 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-537655153", "imageRef": "e9eabea7-33c1-4234-b28b-2ece2974537f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6157eb0-f6af-4bf6-a52c-5c90693edf1d"}], "security_groups": [{"name": "tempest-securitygroup--1225764079"}], "key_name": "tempest-keypair-669137268", "user_data": "}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:56:06.234434 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.network.neutron [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] validate_networks() for [('b6157eb0-f6af-4bf6-a52c-5c90693edf1d', None, None, None, None, None)] {{(pid=134547) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 12:56:06.617323 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Flavor limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 12:56:06.617810 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Image limits 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 12:56:06.618346 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Flavor pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 12:56:06.618820 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Image pref 0:0:0 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 12:56:06.619298 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.virt.hardware [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 12:56:06.628416 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:06.628967 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:06.629884 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:06.630382 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:06.647045 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Getting quotas for project 18e2757f7e6644099af9e5510954a391. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 12:56:06.653411 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.quota [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Getting quotas for user d96f7e82915f4563b05c20c414c23229 and project 18e2757f7e6644099af9e5510954a391. Resources: {'instances', 'ram', 'cores'} {{(pid=134547) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 12:56:06.663358 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Going to run 1 instances... {{(pid=134547) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 12:56:06.666006 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9eabea7-33c1-4234-b28b-2ece2974537f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 12:56:06.715672 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-17c23614-dd1e-4136-8a24-fb923e9a785e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.587766 May 23 12:56:06.716440 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 457/929] 10.222.0.45 () {60 vars in 1146 bytes} [Mon May 23 12:56:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 12:56:06.727409 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-26f22e88-ca0b-46a2-952c-55f99da533a1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:06.728106 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-26f22e88-ca0b-46a2-952c-55f99da533a1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:06.784236 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-26f22e88-ca0b-46a2-952c-55f99da533a1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:06.790930 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-26f22e88-ca0b-46a2-952c-55f99da533a1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1236 microversion: 2.1 time: 0.068226 May 23 12:56:06.791489 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 473/930] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:06 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:07.808514 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0e287239-6986-4ee4-ae2f-fa3e92bf1ded tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:07.810478 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0e287239-6986-4ee4-ae2f-fa3e92bf1ded tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:07.864822 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0e287239-6986-4ee4-ae2f-fa3e92bf1ded tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:07.871408 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0e287239-6986-4ee4-ae2f-fa3e92bf1ded tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1236 microversion: 2.1 time: 0.067719 May 23 12:56:07.872535 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 458/931] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:07 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:08.889008 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-95c5ef5f-43cd-48db-ae95-b22e9e6931c5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:08.889641 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-95c5ef5f-43cd-48db-ae95-b22e9e6931c5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:08.947205 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-95c5ef5f-43cd-48db-ae95-b22e9e6931c5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:08.956283 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-95c5ef5f-43cd-48db-ae95-b22e9e6931c5 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1236 microversion: 2.1 time: 0.071725 May 23 12:56:08.956841 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 474/932] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:08 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:09.973329 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-61db7a4c-a260-4143-8774-9f06c63296cc tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:09.973939 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-61db7a4c-a260-4143-8774-9f06c63296cc tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:10.029249 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-61db7a4c-a260-4143-8774-9f06c63296cc tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:10.035931 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-61db7a4c-a260-4143-8774-9f06c63296cc tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1236 microversion: 2.1 time: 0.066588 May 23 12:56:10.041278 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 459/933] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:09 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:11.052767 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5b46bc95-fde5-48ce-ac3d-d7359ecd756d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:11.053387 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5b46bc95-fde5-48ce-ac3d-d7359ecd756d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:11.060154 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b46bc95-fde5-48ce-ac3d-d7359ecd756d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:11.060587 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b46bc95-fde5-48ce-ac3d-d7359ecd756d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:11.061369 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b46bc95-fde5-48ce-ac3d-d7359ecd756d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:11.061795 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5b46bc95-fde5-48ce-ac3d-d7359ecd756d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:11.122641 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5b46bc95-fde5-48ce-ac3d-d7359ecd756d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:11.131019 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5b46bc95-fde5-48ce-ac3d-d7359ecd756d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1240 microversion: 2.1 time: 0.082108 May 23 12:56:11.131597 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 475/934] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:11 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:12.148410 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-f5e105f1-4e3c-4442-aa56-500f08796c4b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:12.149003 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-f5e105f1-4e3c-4442-aa56-500f08796c4b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:12.157006 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f5e105f1-4e3c-4442-aa56-500f08796c4b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:12.157477 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f5e105f1-4e3c-4442-aa56-500f08796c4b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:12.158267 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f5e105f1-4e3c-4442-aa56-500f08796c4b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:12.158695 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-f5e105f1-4e3c-4442-aa56-500f08796c4b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:12.234879 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-f5e105f1-4e3c-4442-aa56-500f08796c4b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:12.249343 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-f5e105f1-4e3c-4442-aa56-500f08796c4b tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1294 microversion: 2.1 time: 0.104654 May 23 12:56:12.250181 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 460/935] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:12 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:13.159238 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-c6d47315-8395-490d-97f5-9284ee5a5453 req-c005c4a6-68a6-4809-9a43-a96c5e2f57d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e980b755-b373-4bcf-ae80-5b3d70e53d19", "tag": "ae181e71-120e-44d5-b92e-4df2195f592c"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:56:13.188623 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-c6d47315-8395-490d-97f5-9284ee5a5453 req-c005c4a6-68a6-4809-9a43-a96c5e2f57d6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:13.189356 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-c6d47315-8395-490d-97f5-9284ee5a5453 req-c005c4a6-68a6-4809-9a43-a96c5e2f57d6 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:13.203468 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-c6d47315-8395-490d-97f5-9284ee5a5453 req-c005c4a6-68a6-4809-9a43-a96c5e2f57d6 service nova] Creating event network-changed:ae181e71-120e-44d5-b92e-4df2195f592c for instance e980b755-b373-4bcf-ae80-5b3d70e53d19 on hv-cinder-maste May 23 12:56:13.210027 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-c6d47315-8395-490d-97f5-9284ee5a5453 req-c005c4a6-68a6-4809-9a43-a96c5e2f57d6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055375 May 23 12:56:13.210624 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 476/936] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:56:13.266793 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0738aad2-179c-4606-bc14-e7a98e440708 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:13.267523 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0738aad2-179c-4606-bc14-e7a98e440708 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:13.274664 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0738aad2-179c-4606-bc14-e7a98e440708 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:13.275117 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0738aad2-179c-4606-bc14-e7a98e440708 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:13.275897 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0738aad2-179c-4606-bc14-e7a98e440708 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:13.276547 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0738aad2-179c-4606-bc14-e7a98e440708 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:13.469691 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0738aad2-179c-4606-bc14-e7a98e440708 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:13.477530 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0738aad2-179c-4606-bc14-e7a98e440708 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1362 microversion: 2.1 time: 0.214832 May 23 12:56:13.478103 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 461/937] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:13 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:14.495533 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-5eab12e5-26a6-4fa9-a67f-ac428a1e2762 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:14.496220 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-5eab12e5-26a6-4fa9-a67f-ac428a1e2762 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:14.502864 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5eab12e5-26a6-4fa9-a67f-ac428a1e2762 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:14.503310 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5eab12e5-26a6-4fa9-a67f-ac428a1e2762 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:14.504068 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5eab12e5-26a6-4fa9-a67f-ac428a1e2762 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:14.504501 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-5eab12e5-26a6-4fa9-a67f-ac428a1e2762 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:14.647756 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-5eab12e5-26a6-4fa9-a67f-ac428a1e2762 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:14.655256 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-5eab12e5-26a6-4fa9-a67f-ac428a1e2762 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1362 microversion: 2.1 time: 0.163971 May 23 12:56:14.655814 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 477/938] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:14 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:15.672543 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a0152cbc-5a76-4273-bec3-34f1cbad4f17 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:15.673179 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a0152cbc-5a76-4273-bec3-34f1cbad4f17 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:15.675527 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:15.681595 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0152cbc-5a76-4273-bec3-34f1cbad4f17 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:15.682044 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0152cbc-5a76-4273-bec3-34f1cbad4f17 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:15.682808 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0152cbc-5a76-4273-bec3-34f1cbad4f17 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:15.683244 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a0152cbc-5a76-4273-bec3-34f1cbad4f17 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:15.686328 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=71 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:15.818748 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a0152cbc-5a76-4273-bec3-34f1cbad4f17 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:15.826689 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a0152cbc-5a76-4273-bec3-34f1cbad4f17 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1362 microversion: 2.1 time: 0.158638 May 23 12:56:15.827259 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 462/939] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:15 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:16.843902 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-fd68985e-e5ec-4009-a035-467afd0b4fd4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:16.844525 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-fd68985e-e5ec-4009-a035-467afd0b4fd4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:16.846916 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:16.852820 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fd68985e-e5ec-4009-a035-467afd0b4fd4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:16.853293 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fd68985e-e5ec-4009-a035-467afd0b4fd4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:16.854063 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fd68985e-e5ec-4009-a035-467afd0b4fd4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:16.854488 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-fd68985e-e5ec-4009-a035-467afd0b4fd4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:16.858404 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:16.991889 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-fd68985e-e5ec-4009-a035-467afd0b4fd4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:16.999451 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-fd68985e-e5ec-4009-a035-467afd0b4fd4 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1362 microversion: 2.1 time: 0.159703 May 23 12:56:17.000013 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 478/940] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:16 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:18.016278 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a7f19b71-4e38-4d1b-b195-a33adb82d552 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:18.017186 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a7f19b71-4e38-4d1b-b195-a33adb82d552 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:18.019176 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:18.024675 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7f19b71-4e38-4d1b-b195-a33adb82d552 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:18.025124 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7f19b71-4e38-4d1b-b195-a33adb82d552 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:18.025945 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7f19b71-4e38-4d1b-b195-a33adb82d552 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:18.026380 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7f19b71-4e38-4d1b-b195-a33adb82d552 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:18.155779 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a7f19b71-4e38-4d1b-b195-a33adb82d552 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:18.163325 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a7f19b71-4e38-4d1b-b195-a33adb82d552 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1362 microversion: 2.1 time: 0.151061 May 23 12:56:18.163895 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 463/941] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:18 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:18.410441 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-880d488e-a1d4-4a48-aeec-5917b5149365 req-d344a367-1696-41d0-bde1-73a8d14c2ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e980b755-b373-4bcf-ae80-5b3d70e53d19", "name": "network-vif-plugged", "status": "completed", "tag": "ae181e71-120e-44d5-b92e-4df2195f592c"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:56:18.419460 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-880d488e-a1d4-4a48-aeec-5917b5149365 req-d344a367-1696-41d0-bde1-73a8d14c2ac8 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:18.419895 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-880d488e-a1d4-4a48-aeec-5917b5149365 req-d344a367-1696-41d0-bde1-73a8d14c2ac8 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:18.434631 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-880d488e-a1d4-4a48-aeec-5917b5149365 req-d344a367-1696-41d0-bde1-73a8d14c2ac8 service nova] Creating event network-vif-plugged:ae181e71-120e-44d5-b92e-4df2195f592c for instance e980b755-b373-4bcf-ae80-5b3d70e53d19 on hv-cinder-maste May 23 12:56:18.439663 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-880d488e-a1d4-4a48-aeec-5917b5149365 req-d344a367-1696-41d0-bde1-73a8d14c2ac8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033057 May 23 12:56:18.440279 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 479/942] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:56:19.180229 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-7e3cb909-77a0-4aba-b0bc-2c45608a0f13 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:19.180827 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-7e3cb909-77a0-4aba-b0bc-2c45608a0f13 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:19.187482 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7e3cb909-77a0-4aba-b0bc-2c45608a0f13 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:19.187863 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7e3cb909-77a0-4aba-b0bc-2c45608a0f13 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:19.188612 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7e3cb909-77a0-4aba-b0bc-2c45608a0f13 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:19.189042 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-7e3cb909-77a0-4aba-b0bc-2c45608a0f13 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:19.315278 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-7e3cb909-77a0-4aba-b0bc-2c45608a0f13 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:19.323010 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-7e3cb909-77a0-4aba-b0bc-2c45608a0f13 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1362 microversion: 2.1 time: 0.146373 May 23 12:56:19.323567 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 464/943] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:19 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:20.337710 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell0:SELECT=4 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:20.342441 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-90b1d5f4-dc32-4b98-8335-038303eae58e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:20.343166 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-90b1d5f4-dc32-4b98-8335-038303eae58e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:20.349712 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90b1d5f4-dc32-4b98-8335-038303eae58e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:20.350158 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90b1d5f4-dc32-4b98-8335-038303eae58e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:20.350917 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90b1d5f4-dc32-4b98-8335-038303eae58e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:20.351350 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-90b1d5f4-dc32-4b98-8335-038303eae58e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:20.480682 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-90b1d5f4-dc32-4b98-8335-038303eae58e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:56:20.488714 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-90b1d5f4-dc32-4b98-8335-038303eae58e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1548 microversion: 2.1 time: 0.152061 May 23 12:56:20.489299 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 480/944] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:56:20 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:56:20.505297 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-867cbf27-2a42-465a-8faf-b074347d7840 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:20.505815 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-867cbf27-2a42-465a-8faf-b074347d7840 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:20.507601 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell0:SELECT=14 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:20.513252 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-867cbf27-2a42-465a-8faf-b074347d7840 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:20.513743 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-867cbf27-2a42-465a-8faf-b074347d7840 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:20.514505 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-867cbf27-2a42-465a-8faf-b074347d7840 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:20.514943 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-867cbf27-2a42-465a-8faf-b074347d7840 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:20.590565 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-867cbf27-2a42-465a-8faf-b074347d7840 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089163 May 23 12:56:20.591161 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 465/945] 10.222.0.45 () {58 vars in 1274 bytes} [Mon May 23 12:56:20 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:56:21.759033 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-9d137fa1-a13f-4a34-ac97-fd7f95921560 req-e9bc39d4-94c0-4e88-9b4c-68fcdaa79e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e980b755-b373-4bcf-ae80-5b3d70e53d19", "tag": "ae181e71-120e-44d5-b92e-4df2195f592c"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:56:21.767724 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-9d137fa1-a13f-4a34-ac97-fd7f95921560 req-e9bc39d4-94c0-4e88-9b4c-68fcdaa79e3b service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:21.768171 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-9d137fa1-a13f-4a34-ac97-fd7f95921560 req-e9bc39d4-94c0-4e88-9b4c-68fcdaa79e3b service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:21.780820 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-9d137fa1-a13f-4a34-ac97-fd7f95921560 req-e9bc39d4-94c0-4e88-9b4c-68fcdaa79e3b service nova] Creating event network-changed:ae181e71-120e-44d5-b92e-4df2195f592c for instance e980b755-b373-4bcf-ae80-5b3d70e53d19 on hv-cinder-maste May 23 12:56:21.786022 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-9d137fa1-a13f-4a34-ac97-fd7f95921560 req-e9bc39d4-94c0-4e88-9b4c-68fcdaa79e3b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031072 May 23 12:56:21.787055 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 481/946] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:56:27.749330 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:56:27.750013 dv-cinder-master-3-smb devstack@n-api.service[134546]: Mon May 23 12:56:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 12:56:57.609638 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=7 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:57.610410 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=21 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:57.614484 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ae5af282-4db2-4e2b-91fe-875fefcc40b9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:56:57.614968 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ae5af282-4db2-4e2b-91fe-875fefcc40b9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:57.621587 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ae5af282-4db2-4e2b-91fe-875fefcc40b9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:57.622030 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ae5af282-4db2-4e2b-91fe-875fefcc40b9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:57.622772 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ae5af282-4db2-4e2b-91fe-875fefcc40b9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:57.623203 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ae5af282-4db2-4e2b-91fe-875fefcc40b9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:57.646670 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ae5af282-4db2-4e2b-91fe-875fefcc40b9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/ips" status: 200 len: 145 microversion: 2.1 time: 0.038575 May 23 12:56:57.647225 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 466/947] 10.222.0.45 () {58 vars in 1247 bytes} [Mon May 23 12:56:57 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:56:58.961265 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-6504d64d-4301-4d29-9604-3e5a82e28562 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b82ead02-dabf-43a1-9a84-cdc589ce1c3b"}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:56:58.962438 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-6504d64d-4301-4d29-9604-3e5a82e28562 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:56:58.964459 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=7 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:58.965237 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=15 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:56:58.971646 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6504d64d-4301-4d29-9604-3e5a82e28562 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:58.972096 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6504d64d-4301-4d29-9604-3e5a82e28562 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:58.972861 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6504d64d-4301-4d29-9604-3e5a82e28562 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:56:58.973328 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-6504d64d-4301-4d29-9604-3e5a82e28562 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:56:59.215918 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-6504d64d-4301-4d29-9604-3e5a82e28562 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259373 May 23 12:56:59.216522 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 482/948] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:56:58 2022] POST /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 12:57:00.388395 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ca42c555-dda2-48bf-9810-7f013cfdba8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:00.389399 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ca42c555-dda2-48bf-9810-7f013cfdba8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:00.396477 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca42c555-dda2-48bf-9810-7f013cfdba8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:00.396962 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca42c555-dda2-48bf-9810-7f013cfdba8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:00.397750 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca42c555-dda2-48bf-9810-7f013cfdba8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:00.398186 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ca42c555-dda2-48bf-9810-7f013cfdba8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:00.427001 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ca42c555-dda2-48bf-9810-7f013cfdba8c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 May 23 12:57:00.427580 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 467/949] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:57:00 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:57:00.439465 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-37170d98-5f47-4451-b18f-8e2e42712730 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:00.440016 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-37170d98-5f47-4451-b18f-8e2e42712730 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:00.446242 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-37170d98-5f47-4451-b18f-8e2e42712730 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:00.446687 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-37170d98-5f47-4451-b18f-8e2e42712730 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:00.447446 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-37170d98-5f47-4451-b18f-8e2e42712730 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:00.447876 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-37170d98-5f47-4451-b18f-8e2e42712730 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:00.476780 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-37170d98-5f47-4451-b18f-8e2e42712730 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments/b82ead02-dabf-43a1-9a84-cdc589ce1c3b" status: 200 len: 194 microversion: 2.1 time: 0.043193 May 23 12:57:00.477384 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 483/950] 10.222.0.45 () {58 vars in 1412 bytes} [Mon May 23 12:57:00 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments/b82ead02-dabf-43a1-9a84-cdc589ce1c3b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:57:01.801171 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-95cbf010-c122-427e-b475-52aea791145c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e529949-900d-460f-bdfd-ae23242fc0cb"}} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:57:01.802223 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-95cbf010-c122-427e-b475-52aea791145c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:01.808571 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-95cbf010-c122-427e-b475-52aea791145c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:01.809019 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-95cbf010-c122-427e-b475-52aea791145c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:01.809794 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-95cbf010-c122-427e-b475-52aea791145c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:01.810223 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-95cbf010-c122-427e-b475-52aea791145c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:02.043530 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-95cbf010-c122-427e-b475-52aea791145c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "POST /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246705 May 23 12:57:02.044513 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 468/951] 10.222.0.45 () {60 vars in 1322 bytes} [Mon May 23 12:57:01 2022] POST /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:57:04.273182 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-28d9522c-3321-4c5e-95f4-98b0a098fa74 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:04.274187 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-28d9522c-3321-4c5e-95f4-98b0a098fa74 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:04.280505 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-28d9522c-3321-4c5e-95f4-98b0a098fa74 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:04.280949 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-28d9522c-3321-4c5e-95f4-98b0a098fa74 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:04.282248 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-28d9522c-3321-4c5e-95f4-98b0a098fa74 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:04.282703 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-28d9522c-3321-4c5e-95f4-98b0a098fa74 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:04.311725 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-28d9522c-3321-4c5e-95f4-98b0a098fa74 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042560 May 23 12:57:04.312260 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 484/952] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:57:04 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:57:04.458221 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3ed97f0d-5c09-4a93-852d-edb6c1a12b7d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:04.458752 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3ed97f0d-5c09-4a93-852d-edb6c1a12b7d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:04.465225 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3ed97f0d-5c09-4a93-852d-edb6c1a12b7d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:04.465674 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3ed97f0d-5c09-4a93-852d-edb6c1a12b7d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:04.466421 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3ed97f0d-5c09-4a93-852d-edb6c1a12b7d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:04.466848 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3ed97f0d-5c09-4a93-852d-edb6c1a12b7d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:04.495391 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3ed97f0d-5c09-4a93-852d-edb6c1a12b7d tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments/b82ead02-dabf-43a1-9a84-cdc589ce1c3b" status: 200 len: 194 microversion: 2.1 time: 0.042603 May 23 12:57:04.495959 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 469/953] 10.222.0.45 () {58 vars in 1412 bytes} [Mon May 23 12:57:04 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments/b82ead02-dabf-43a1-9a84-cdc589ce1c3b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:57:04.506217 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8c6c0371-c05a-42b8-900a-d8250bf0c28f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:04.506709 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8c6c0371-c05a-42b8-900a-d8250bf0c28f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:04.512569 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c6c0371-c05a-42b8-900a-d8250bf0c28f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:04.513015 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c6c0371-c05a-42b8-900a-d8250bf0c28f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:04.513796 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c6c0371-c05a-42b8-900a-d8250bf0c28f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:04.514229 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8c6c0371-c05a-42b8-900a-d8250bf0c28f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:04.593784 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-8c6c0371-c05a-42b8-900a-d8250bf0c28f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lazy-loading 'services' on Instance uuid e980b755-b373-4bcf-ae80-5b3d70e53d19 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:57:04.663680 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8c6c0371-c05a-42b8-900a-d8250bf0c28f tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments/b82ead02-dabf-43a1-9a84-cdc589ce1c3b" status: 202 len: 0 microversion: 2.1 time: 0.161236 May 23 12:57:04.664270 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 485/954] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:57:04 2022] DELETE /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments/b82ead02-dabf-43a1-9a84-cdc589ce1c3b => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 12:57:05.778579 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a21e6acc-8940-4604-8de5-f2af07195cd3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:05.779181 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a21e6acc-8940-4604-8de5-f2af07195cd3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:05.785585 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a21e6acc-8940-4604-8de5-f2af07195cd3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:05.786037 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a21e6acc-8940-4604-8de5-f2af07195cd3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:05.786795 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a21e6acc-8940-4604-8de5-f2af07195cd3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:05.787229 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a21e6acc-8940-4604-8de5-f2af07195cd3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:05.815250 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a21e6acc-8940-4604-8de5-f2af07195cd3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments/3e529949-900d-460f-bdfd-ae23242fc0cb" status: 200 len: 194 microversion: 2.1 time: 0.040577 May 23 12:57:05.815838 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 470/955] 10.222.0.45 () {58 vars in 1412 bytes} [Mon May 23 12:57:05 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments/3e529949-900d-460f-bdfd-ae23242fc0cb => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:57:05.825978 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-0e1cb1e9-512a-4479-9807-e887f91a9fa9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:05.826555 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-0e1cb1e9-512a-4479-9807-e887f91a9fa9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:05.833826 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0e1cb1e9-512a-4479-9807-e887f91a9fa9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:05.834274 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0e1cb1e9-512a-4479-9807-e887f91a9fa9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:05.835292 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0e1cb1e9-512a-4479-9807-e887f91a9fa9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:05.835723 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-0e1cb1e9-512a-4479-9807-e887f91a9fa9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:05.914690 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-0e1cb1e9-512a-4479-9807-e887f91a9fa9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lazy-loading 'services' on Instance uuid e980b755-b373-4bcf-ae80-5b3d70e53d19 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:57:05.984106 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-0e1cb1e9-512a-4479-9807-e887f91a9fa9 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments/3e529949-900d-460f-bdfd-ae23242fc0cb" status: 202 len: 0 microversion: 2.1 time: 0.162148 May 23 12:57:05.984620 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 486/956] 10.222.0.45 () {58 vars in 1415 bytes} [Mon May 23 12:57:05 2022] DELETE /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments/3e529949-900d-460f-bdfd-ae23242fc0cb => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:57:07.143336 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-38198e46-d505-4fbc-846e-7b917571027c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:07.144339 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-38198e46-d505-4fbc-846e-7b917571027c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:07.150790 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-38198e46-d505-4fbc-846e-7b917571027c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:07.151233 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-38198e46-d505-4fbc-846e-7b917571027c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:07.151982 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-38198e46-d505-4fbc-846e-7b917571027c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:07.152409 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-38198e46-d505-4fbc-846e-7b917571027c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:07.180267 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-38198e46-d505-4fbc-846e-7b917571027c tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042964 May 23 12:57:07.180807 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 471/957] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:57:07 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 12:57:07.285929 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-df2fc67e-a5a0-4fe0-8012-49fdad1c0155 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:07.286928 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-df2fc67e-a5a0-4fe0-8012-49fdad1c0155 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:07.293067 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-df2fc67e-a5a0-4fe0-8012-49fdad1c0155 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:07.293549 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-df2fc67e-a5a0-4fe0-8012-49fdad1c0155 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:07.294307 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-df2fc67e-a5a0-4fe0-8012-49fdad1c0155 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:07.294737 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-df2fc67e-a5a0-4fe0-8012-49fdad1c0155 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:07.323180 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-df2fc67e-a5a0-4fe0-8012-49fdad1c0155 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042104 May 23 12:57:07.323723 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 487/958] 10.222.0.45 () {58 vars in 1301 bytes} [Mon May 23 12:57:07 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 12:57:07.383016 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-fef1c0af-268e-4d5d-8cae-0fd6af9ce3b3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:07.383517 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-fef1c0af-268e-4d5d-8cae-0fd6af9ce3b3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:07.389492 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fef1c0af-268e-4d5d-8cae-0fd6af9ce3b3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:07.389944 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fef1c0af-268e-4d5d-8cae-0fd6af9ce3b3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:07.390702 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fef1c0af-268e-4d5d-8cae-0fd6af9ce3b3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:07.391833 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fef1c0af-268e-4d5d-8cae-0fd6af9ce3b3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:07.416891 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-fef1c0af-268e-4d5d-8cae-0fd6af9ce3b3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Going to try to terminate instance {{(pid=134547) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:57:07.492643 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-fef1c0af-268e-4d5d-8cae-0fd6af9ce3b3 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 204 len: 0 microversion: 2.1 time: 0.112955 May 23 12:57:07.493421 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 472/959] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:57:07 2022] DELETE /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:57:07.502569 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c5604421-28ea-4e25-88e8-ed653cc1d4f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:07.503201 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c5604421-28ea-4e25-88e8-ed653cc1d4f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:07.509582 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c5604421-28ea-4e25-88e8-ed653cc1d4f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:07.510028 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c5604421-28ea-4e25-88e8-ed653cc1d4f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:07.510789 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c5604421-28ea-4e25-88e8-ed653cc1d4f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:07.511220 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c5604421-28ea-4e25-88e8-ed653cc1d4f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:07.646088 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c5604421-28ea-4e25-88e8-ed653cc1d4f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:57:07.653599 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c5604421-28ea-4e25-88e8-ed653cc1d4f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1672 microversion: 2.1 time: 0.155442 May 23 12:57:07.654284 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 488/960] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:57:07 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:57:08.672917 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-0228edab-c4ba-4005-8586-033957bd6e3e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:08.674450 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-0228edab-c4ba-4005-8586-033957bd6e3e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:08.680911 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0228edab-c4ba-4005-8586-033957bd6e3e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:08.681383 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0228edab-c4ba-4005-8586-033957bd6e3e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:08.682133 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0228edab-c4ba-4005-8586-033957bd6e3e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:08.682562 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-0228edab-c4ba-4005-8586-033957bd6e3e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:08.809806 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-0228edab-c4ba-4005-8586-033957bd6e3e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:57:08.817953 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-0228edab-c4ba-4005-8586-033957bd6e3e tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1672 microversion: 2.1 time: 0.149400 May 23 12:57:08.818519 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 473/961] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:57:08 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:57:09.843737 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-065bcb1f-3cdb-4ed1-be28-e0656b0ad5c8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:09.844369 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-065bcb1f-3cdb-4ed1-be28-e0656b0ad5c8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:09.851080 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-065bcb1f-3cdb-4ed1-be28-e0656b0ad5c8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:09.851520 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-065bcb1f-3cdb-4ed1-be28-e0656b0ad5c8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:09.852271 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-065bcb1f-3cdb-4ed1-be28-e0656b0ad5c8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:09.852725 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-065bcb1f-3cdb-4ed1-be28-e0656b0ad5c8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:09.916020 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-065bcb1f-3cdb-4ed1-be28-e0656b0ad5c8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f7e82915f4563b05c20c414c23229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e2757f7e6644099af9e5510954a391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:57:09.924174 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-065bcb1f-3cdb-4ed1-be28-e0656b0ad5c8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 200 len: 1604 microversion: 2.1 time: 0.083841 May 23 12:57:09.925022 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 489/962] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:57:09 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 1604 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:57:10.056299 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [req-adc03eb9-1038-4c6d-82da-4ef4af20d816 req-c85ebe5c-0c45-4cc6-b6ad-baa142b5a40c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e980b755-b373-4bcf-ae80-5b3d70e53d19", "name": "network-vif-deleted", "tag": "ae181e71-120e-44d5-b92e-4df2195f592c"}]} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:57:10.067189 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-adc03eb9-1038-4c6d-82da-4ef4af20d816 req-c85ebe5c-0c45-4cc6-b6ad-baa142b5a40c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:10.068398 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [req-adc03eb9-1038-4c6d-82da-4ef4af20d816 req-c85ebe5c-0c45-4cc6-b6ad-baa142b5a40c service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:10.081691 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.compute.server_external_events [req-adc03eb9-1038-4c6d-82da-4ef4af20d816 req-c85ebe5c-0c45-4cc6-b6ad-baa142b5a40c service nova] Creating event network-vif-deleted:ae181e71-120e-44d5-b92e-4df2195f592c for instance e980b755-b373-4bcf-ae80-5b3d70e53d19 on hv-cinder-maste May 23 12:57:10.098199 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [req-adc03eb9-1038-4c6d-82da-4ef4af20d816 req-c85ebe5c-0c45-4cc6-b6ad-baa142b5a40c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046821 May 23 12:57:10.100287 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 474/963] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:57:10.942330 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e9438770-7cde-436b-bef8-6014f8ff24aa tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:10.942886 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-e9438770-7cde-436b-bef8-6014f8ff24aa tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:10.949343 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9438770-7cde-436b-bef8-6014f8ff24aa tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:10.949809 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9438770-7cde-436b-bef8-6014f8ff24aa tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:10.950555 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9438770-7cde-436b-bef8-6014f8ff24aa tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:10.950983 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-e9438770-7cde-436b-bef8-6014f8ff24aa tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:10.965267 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-e9438770-7cde-436b-bef8-6014f8ff24aa tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] HTTP exception thrown: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e9438770-7cde-436b-bef8-6014f8ff24aa tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Request method failure captured: May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 HTTP/1.1 May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4PHQkMmWeG5PNlc-ytG3ePou8qKHbru5hTFOO4o0rhccB6-CV1KyBFCIEoDGu1FsIGGBz_NQjPfLrQw6LqfFkzz0W0fzoKzmGiiOAiwbklXP5icIwUVPb7hqgER2wmEmHGWzWfPiI9jE5_Y_tbC1bVPrdggVYrKRbaeACOuWA86YZw May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:57:10.966905 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/18e2757f7e6644099af9e5510954a391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_18e2757f7e6644099af9e5510954a391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d96f7e82915f4563b05c20c414c23229 May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:10.968412 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'e980b755-b373-4bcf-ae80-5b3d70e53d19'} May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:57:10.969249 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:10.971422 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:10.973107 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-e9438770-7cde-436b-bef8-6014f8ff24aa tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Returning 404 to user: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:57:10.973107 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-e9438770-7cde-436b-bef8-6014f8ff24aa tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 404 len: 111 microversion: 2.1 time: 0.030954 May 23 12:57:10.973107 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 490/964] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:57:10 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:57:10.979286 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-773b0ed4-9a35-4d75-bed9-fe301108e978 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '.version_select at 0x7f6a36bf3e50>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:10.997050 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-773b0ed4-9a35-4d75-bed9-fe301108e978 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-669137268" status: 202 len: 0 microversion: 2.1 time: 0.022220 May 23 12:57:10.998121 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 475/965] 10.222.0.45 () {58 vars in 1217 bytes} [Mon May 23 12:57:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-669137268 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:57:13.871044 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7b9b1e84-b6e9-4d78-8c0b-a8fe4f314339 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:13.871560 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7b9b1e84-b6e9-4d78-8c0b-a8fe4f314339 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:13.878484 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7b9b1e84-b6e9-4d78-8c0b-a8fe4f314339 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:13.878932 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7b9b1e84-b6e9-4d78-8c0b-a8fe4f314339 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:13.879687 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7b9b1e84-b6e9-4d78-8c0b-a8fe4f314339 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:13.880116 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7b9b1e84-b6e9-4d78-8c0b-a8fe4f314339 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:13.894083 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-7b9b1e84-b6e9-4d78-8c0b-a8fe4f314339 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] HTTP exception thrown: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7b9b1e84-b6e9-4d78-8c0b-a8fe4f314339 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Request method failure captured: May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: DELETE /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 HTTP/1.1 May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4PHQkMmWeG5PNlc-ytG3ePou8qKHbru5hTFOO4o0rhccB6-CV1KyBFCIEoDGu1FsIGGBz_NQjPfLrQw6LqfFkzz0W0fzoKzmGiiOAiwbklXP5icIwUVPb7hqgER2wmEmHGWzWfPiI9jE5_Y_tbC1bVPrdggVYrKRbaeACOuWA86YZw May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:57:13.895621 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/18e2757f7e6644099af9e5510954a391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_18e2757f7e6644099af9e5510954a391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d96f7e82915f4563b05c20c414c23229 May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:13.897914 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': 'e980b755-b373-4bcf-ae80-5b3d70e53d19'} May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:57:13.898750 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:13.899968 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:13.901290 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7b9b1e84-b6e9-4d78-8c0b-a8fe4f314339 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Returning 404 to user: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:57:13.901290 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7b9b1e84-b6e9-4d78-8c0b-a8fe4f314339 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 404 len: 111 microversion: 2.1 time: 0.029800 May 23 12:57:13.901290 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 491/966] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:57:13 2022] DELETE /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:57:13.905983 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2c1c0b4f-5d8b-4697-b8b8-007e970b46f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:13.906715 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2c1c0b4f-5d8b-4697-b8b8-007e970b46f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: e980b755-b373-4bcf-ae80-5b3d70e53d19] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:13.912840 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c1c0b4f-5d8b-4697-b8b8-007e970b46f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:13.913338 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c1c0b4f-5d8b-4697-b8b8-007e970b46f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:13.914108 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c1c0b4f-5d8b-4697-b8b8-007e970b46f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:13.914549 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2c1c0b4f-5d8b-4697-b8b8-007e970b46f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:13.927594 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-2c1c0b4f-5d8b-4697-b8b8-007e970b46f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] HTTP exception thrown: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2c1c0b4f-5d8b-4697-b8b8-007e970b46f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Request method failure captured: May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 HTTP/1.1 May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4PHQkMmWeG5PNlc-ytG3ePou8qKHbru5hTFOO4o0rhccB6-CV1KyBFCIEoDGu1FsIGGBz_NQjPfLrQw6LqfFkzz0W0fzoKzmGiiOAiwbklXP5icIwUVPb7hqgER2wmEmHGWzWfPiI9jE5_Y_tbC1bVPrdggVYrKRbaeACOuWA86YZw May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:57:13.929211 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/18e2757f7e6644099af9e5510954a391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_18e2757f7e6644099af9e5510954a391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: d96f7e82915f4563b05c20c414c23229 May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:13.930779 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': 'e980b755-b373-4bcf-ae80-5b3d70e53d19'} May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:57:13.931797 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. May 23 12:57:13.933406 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:57:13.934784 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2c1c0b4f-5d8b-4697-b8b8-007e970b46f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Returning 404 to user: Instance e980b755-b373-4bcf-ae80-5b3d70e53d19 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:57:13.934784 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2c1c0b4f-5d8b-4697-b8b8-007e970b46f8 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19" status: 404 len: 111 microversion: 2.1 time: 0.028990 May 23 12:57:13.934784 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 476/967] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:57:13 2022] GET /compute/v2.1/servers/e980b755-b373-4bcf-ae80-5b3d70e53d19 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:57:15.064369 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8a57193e-f786-4764-8f02-2cf0cb47f3fb tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:15.064926 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8a57193e-f786-4764-8f02-2cf0cb47f3fb tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:15.072209 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8a57193e-f786-4764-8f02-2cf0cb47f3fb tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:15.072658 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8a57193e-f786-4764-8f02-2cf0cb47f3fb tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:15.073460 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8a57193e-f786-4764-8f02-2cf0cb47f3fb tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:15.073898 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8a57193e-f786-4764-8f02-2cf0cb47f3fb tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:15.087547 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.wsgi [None req-8a57193e-f786-4764-8f02-2cf0cb47f3fb tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] HTTP exception thrown: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8a57193e-f786-4764-8f02-2cf0cb47f3fb tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Request method failure captured: May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: request: DELETE /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 HTTP/1.1 May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept: application/json May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: Accept-Encoding: identity May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: Connection: close May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Length: 0 May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: Content-Type: application/json May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: Host: 10.222.0.45 May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: Openstack-System-Scope: None May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: User-Agent: python-urllib3/1.26.9 May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Auth-Token: gAAAAABii4PHQkMmWeG5PNlc-ytG3ePou8qKHbru5hTFOO4o0rhccB6-CV1KyBFCIEoDGu1FsIGGBz_NQjPfLrQw6LqfFkzz0W0fzoKzmGiiOAiwbklXP5icIwUVPb7hqgER2wmEmHGWzWfPiI9jE5_Y_tbC1bVPrdggVYrKRbaeACOuWA86YZw May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Id: None May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Domain-Name: None May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Identity-Status: Confirmed May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Is-Admin-Project: True May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Id: default May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Domain-Name: Default May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Project-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Role: reader,member May 23 12:57:15.089084 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Roles: reader,member May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/18e2757f7e6644099af9e5510954a391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_18e2757f7e6644099af9e5510954a391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Id: default May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Domain-Name: Default May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Id: d96f7e82915f4563b05c20c414c23229 May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: X-User-Name: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: method: > May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: exception: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:57:15.090729 dv-cinder-master-3-smb devstack@n-api.service[134546]: action_args: {'id': '73540f41-a90c-4826-8a73-3883ce48a0d1'} May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:57:15.091586 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:57:15.092852 dv-cinder-master-3-smb devstack@n-api.service[134546]: ERROR nova.api.openstack.wsgi May 23 12:57:15.094202 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8a57193e-f786-4764-8f02-2cf0cb47f3fb tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Returning 404 to user: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. {{(pid=134546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:57:15.094202 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8a57193e-f786-4764-8f02-2cf0cb47f3fb tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "DELETE /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 404 len: 111 microversion: 2.1 time: 0.030108 May 23 12:57:15.094202 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 492/968] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:57:15 2022] DELETE /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:57:15.098968 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-54623d84-1799-416f-9fdb-a6255abef8d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:15.099580 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-54623d84-1799-416f-9fdb-a6255abef8d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] [instance: 73540f41-a90c-4826-8a73-3883ce48a0d1] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:15.105996 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-54623d84-1799-416f-9fdb-a6255abef8d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:15.106446 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-54623d84-1799-416f-9fdb-a6255abef8d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:15.107204 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-54623d84-1799-416f-9fdb-a6255abef8d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:15.107640 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-54623d84-1799-416f-9fdb-a6255abef8d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:15.121437 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-54623d84-1799-416f-9fdb-a6255abef8d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] HTTP exception thrown: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-54623d84-1799-416f-9fdb-a6255abef8d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Request method failure captured: May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 HTTP/1.1 May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4PHQkMmWeG5PNlc-ytG3ePou8qKHbru5hTFOO4o0rhccB6-CV1KyBFCIEoDGu1FsIGGBz_NQjPfLrQw6LqfFkzz0W0fzoKzmGiiOAiwbklXP5icIwUVPb7hqgER2wmEmHGWzWfPiI9jE5_Y_tbC1bVPrdggVYrKRbaeACOuWA86YZw May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:57:15.122946 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/18e2757f7e6644099af9e5510954a391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18e2757f7e6644099af9e5510954a391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_18e2757f7e6644099af9e5510954a391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 18e2757f7e6644099af9e5510954a391 May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2001540863 May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: d96f7e82915f4563b05c20c414c23229 May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-AttachVolumeTestJSON-2001540863-project May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:57:15.124490 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': '73540f41-a90c-4826-8a73-3883ce48a0d1'} May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:57:15.125355 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. May 23 12:57:15.126879 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:57:15.128960 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-54623d84-1799-416f-9fdb-a6255abef8d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] Returning 404 to user: Instance 73540f41-a90c-4826-8a73-3883ce48a0d1 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:57:15.128960 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-54623d84-1799-416f-9fdb-a6255abef8d1 tempest-AttachVolumeTestJSON-2001540863 tempest-AttachVolumeTestJSON-2001540863-project] 10.222.0.45 "GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1" status: 404 len: 111 microversion: 2.1 time: 0.029335 May 23 12:57:15.128960 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 477/969] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:57:15 2022] GET /compute/v2.1/servers/73540f41-a90c-4826-8a73-3883ce48a0d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:57:59.498898 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-bb164176-052a-4647-8d5a-47756affc74b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:57:59.499552 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-bb164176-052a-4647-8d5a-47756affc74b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:59.501639 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=22 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:59.502309 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:59.508108 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb164176-052a-4647-8d5a-47756affc74b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:59.508617 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb164176-052a-4647-8d5a-47756affc74b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:59.509414 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb164176-052a-4647-8d5a-47756affc74b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:59.509847 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-bb164176-052a-4647-8d5a-47756affc74b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:59.534298 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.objects.instance [None req-bb164176-052a-4647-8d5a-47756affc74b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lazy-loading 'flavor' on Instance uuid fff8f49d-1e9e-4ed2-891c-c88d71d981d3 {{(pid=134546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 12:57:59.607555 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-bb164176-052a-4647-8d5a-47756affc74b tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "POST /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3/action" status: 202 len: 0 microversion: 2.1 time: 0.112777 May 23 12:57:59.608043 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 493/970] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:57:59 2022] POST /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:57:59.616717 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ebe43829-2a49-4104-bd24-d3b7aae36d77 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:57:59.618140 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ebe43829-2a49-4104-bd24-d3b7aae36d77 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:57:59.620669 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:59.621380 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:57:59.627489 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ebe43829-2a49-4104-bd24-d3b7aae36d77 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:59.627984 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ebe43829-2a49-4104-bd24-d3b7aae36d77 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:59.628816 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ebe43829-2a49-4104-bd24-d3b7aae36d77 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:57:59.629432 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ebe43829-2a49-4104-bd24-d3b7aae36d77 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:57:59.767350 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ebe43829-2a49-4104-bd24-d3b7aae36d77 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:57:59.774983 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ebe43829-2a49-4104-bd24-d3b7aae36d77 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.162436 May 23 12:57:59.775542 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 478/971] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:57:59 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:58:00.793679 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-d41aca54-c2a7-46a9-9c2f-a394ca2bc0b5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:00.794373 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-d41aca54-c2a7-46a9-9c2f-a394ca2bc0b5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:00.800683 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d41aca54-c2a7-46a9-9c2f-a394ca2bc0b5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:00.801122 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d41aca54-c2a7-46a9-9c2f-a394ca2bc0b5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:00.801893 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d41aca54-c2a7-46a9-9c2f-a394ca2bc0b5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:00.802322 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-d41aca54-c2a7-46a9-9c2f-a394ca2bc0b5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:01.092480 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-d41aca54-c2a7-46a9-9c2f-a394ca2bc0b5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:01.099956 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-d41aca54-c2a7-46a9-9c2f-a394ca2bc0b5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.311662 May 23 12:58:01.100514 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 494/972] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:00 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:02.117642 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e7302d18-481c-4a5e-b9ae-2eacfd120f39 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:02.118454 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e7302d18-481c-4a5e-b9ae-2eacfd120f39 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:02.125019 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e7302d18-481c-4a5e-b9ae-2eacfd120f39 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:02.125499 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e7302d18-481c-4a5e-b9ae-2eacfd120f39 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:02.126262 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e7302d18-481c-4a5e-b9ae-2eacfd120f39 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:02.126687 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e7302d18-481c-4a5e-b9ae-2eacfd120f39 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:02.311354 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e7302d18-481c-4a5e-b9ae-2eacfd120f39 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:02.318922 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e7302d18-481c-4a5e-b9ae-2eacfd120f39 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.205093 May 23 12:58:02.319487 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 479/973] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:02 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:03.336544 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-8195078c-6300-4545-9031-ee4038ca1259 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:03.337935 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-8195078c-6300-4545-9031-ee4038ca1259 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:03.344437 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8195078c-6300-4545-9031-ee4038ca1259 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:03.344881 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8195078c-6300-4545-9031-ee4038ca1259 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:03.345676 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8195078c-6300-4545-9031-ee4038ca1259 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:03.346110 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-8195078c-6300-4545-9031-ee4038ca1259 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:03.473471 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-8195078c-6300-4545-9031-ee4038ca1259 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:03.480877 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-8195078c-6300-4545-9031-ee4038ca1259 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.148553 May 23 12:58:03.481460 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 495/974] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:03 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:04.497569 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-2f7c7db1-9c71-4597-b217-753194c6fe1e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:04.498174 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-2f7c7db1-9c71-4597-b217-753194c6fe1e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:04.504522 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2f7c7db1-9c71-4597-b217-753194c6fe1e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:04.504959 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2f7c7db1-9c71-4597-b217-753194c6fe1e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:04.505733 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2f7c7db1-9c71-4597-b217-753194c6fe1e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:04.506162 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-2f7c7db1-9c71-4597-b217-753194c6fe1e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:04.637735 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-2f7c7db1-9c71-4597-b217-753194c6fe1e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:04.645090 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-2f7c7db1-9c71-4597-b217-753194c6fe1e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.151707 May 23 12:58:04.645688 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 480/975] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:04 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:05.662893 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-7c8a99c7-dd27-4240-9d47-62943fd221cb tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:05.663434 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-7c8a99c7-dd27-4240-9d47-62943fd221cb tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:05.670212 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7c8a99c7-dd27-4240-9d47-62943fd221cb tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:05.670654 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7c8a99c7-dd27-4240-9d47-62943fd221cb tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:05.671410 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7c8a99c7-dd27-4240-9d47-62943fd221cb tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:05.671840 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-7c8a99c7-dd27-4240-9d47-62943fd221cb tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:05.809278 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-7c8a99c7-dd27-4240-9d47-62943fd221cb tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:05.816722 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-7c8a99c7-dd27-4240-9d47-62943fd221cb tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.157796 May 23 12:58:05.817319 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 496/976] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:05 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:06.834324 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-3d8b3af1-ddf8-46d0-a7d9-e898c6df8976 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:06.835190 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-3d8b3af1-ddf8-46d0-a7d9-e898c6df8976 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:06.841834 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d8b3af1-ddf8-46d0-a7d9-e898c6df8976 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:06.842284 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d8b3af1-ddf8-46d0-a7d9-e898c6df8976 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:06.843044 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d8b3af1-ddf8-46d0-a7d9-e898c6df8976 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:06.843481 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-3d8b3af1-ddf8-46d0-a7d9-e898c6df8976 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:06.972390 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-3d8b3af1-ddf8-46d0-a7d9-e898c6df8976 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:06.981547 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-3d8b3af1-ddf8-46d0-a7d9-e898c6df8976 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.150913 May 23 12:58:06.982237 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 481/977] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:06 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:07.998674 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-b7219238-9ca0-4dee-8701-479297d1ecb3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:07.999274 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-b7219238-9ca0-4dee-8701-479297d1ecb3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:08.005697 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b7219238-9ca0-4dee-8701-479297d1ecb3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:08.006135 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b7219238-9ca0-4dee-8701-479297d1ecb3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:08.006881 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b7219238-9ca0-4dee-8701-479297d1ecb3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:08.007305 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-b7219238-9ca0-4dee-8701-479297d1ecb3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:08.136790 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-b7219238-9ca0-4dee-8701-479297d1ecb3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:08.144249 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-b7219238-9ca0-4dee-8701-479297d1ecb3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.149427 May 23 12:58:08.144804 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 497/978] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:07 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:09.162223 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-fdb1bcd7-0ce8-45f2-ba68-dcac77bdb4ea tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:09.162820 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-fdb1bcd7-0ce8-45f2-ba68-dcac77bdb4ea tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:09.169897 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fdb1bcd7-0ce8-45f2-ba68-dcac77bdb4ea tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:09.170336 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fdb1bcd7-0ce8-45f2-ba68-dcac77bdb4ea tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:09.171099 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fdb1bcd7-0ce8-45f2-ba68-dcac77bdb4ea tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:09.171534 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-fdb1bcd7-0ce8-45f2-ba68-dcac77bdb4ea tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:09.310840 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-fdb1bcd7-0ce8-45f2-ba68-dcac77bdb4ea tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:09.318267 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-fdb1bcd7-0ce8-45f2-ba68-dcac77bdb4ea tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.160110 May 23 12:58:09.318837 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 482/979] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:09 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:10.335529 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-c5cc6904-c06c-408e-ab30-ad1415a193f8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:10.336138 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-c5cc6904-c06c-408e-ab30-ad1415a193f8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:10.343735 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c5cc6904-c06c-408e-ab30-ad1415a193f8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:10.344182 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c5cc6904-c06c-408e-ab30-ad1415a193f8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:10.344952 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c5cc6904-c06c-408e-ab30-ad1415a193f8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:10.345413 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-c5cc6904-c06c-408e-ab30-ad1415a193f8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:10.478323 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-c5cc6904-c06c-408e-ab30-ad1415a193f8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:10.485777 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-c5cc6904-c06c-408e-ab30-ad1415a193f8 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.154405 May 23 12:58:10.486342 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 498/980] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:10 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:11.503062 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-9a7eb6d0-6a10-461d-92cb-abf19f72d7a5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:11.503658 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-9a7eb6d0-6a10-461d-92cb-abf19f72d7a5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:11.510762 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9a7eb6d0-6a10-461d-92cb-abf19f72d7a5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:11.511199 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9a7eb6d0-6a10-461d-92cb-abf19f72d7a5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:11.512309 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9a7eb6d0-6a10-461d-92cb-abf19f72d7a5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:11.512509 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-9a7eb6d0-6a10-461d-92cb-abf19f72d7a5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:11.646679 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-9a7eb6d0-6a10-461d-92cb-abf19f72d7a5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:11.655504 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-9a7eb6d0-6a10-461d-92cb-abf19f72d7a5 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1569 microversion: 2.1 time: 0.156291 May 23 12:58:11.656298 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 483/981] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:11 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:12.672680 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-010e4702-14c9-46a0-b3e8-a4ffbfc5e6bd tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:12.673255 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-010e4702-14c9-46a0-b3e8-a4ffbfc5e6bd tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:12.679624 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-010e4702-14c9-46a0-b3e8-a4ffbfc5e6bd tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:12.680063 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-010e4702-14c9-46a0-b3e8-a4ffbfc5e6bd tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:12.681372 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-010e4702-14c9-46a0-b3e8-a4ffbfc5e6bd tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:12.681797 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-010e4702-14c9-46a0-b3e8-a4ffbfc5e6bd tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:12.815416 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-010e4702-14c9-46a0-b3e8-a4ffbfc5e6bd tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:12.823011 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-010e4702-14c9-46a0-b3e8-a4ffbfc5e6bd tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1510 microversion: 2.1 time: 0.154402 May 23 12:58:12.823569 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 499/982] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:12 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:12.839846 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-49015fd3-19c9-4063-90fa-6b0fbe3514e3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:58:12.840410 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-49015fd3-19c9-4063-90fa-6b0fbe3514e3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:12.846749 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-49015fd3-19c9-4063-90fa-6b0fbe3514e3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:12.847201 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-49015fd3-19c9-4063-90fa-6b0fbe3514e3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:12.847933 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-49015fd3-19c9-4063-90fa-6b0fbe3514e3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:12.848361 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-49015fd3-19c9-4063-90fa-6b0fbe3514e3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:12.936467 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-49015fd3-19c9-4063-90fa-6b0fbe3514e3 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "POST /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3/action" status: 202 len: 0 microversion: 2.1 time: 0.100158 May 23 12:58:12.937005 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 484/983] 10.222.0.45 () {60 vars in 1277 bytes} [Mon May 23 12:58:12 2022] POST /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:58:12.945168 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-072a2a73-eb69-4360-b142-d37edad4a78c tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:12.945833 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-072a2a73-eb69-4360-b142-d37edad4a78c tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:12.952551 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-072a2a73-eb69-4360-b142-d37edad4a78c tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:12.952997 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-072a2a73-eb69-4360-b142-d37edad4a78c tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:12.953801 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-072a2a73-eb69-4360-b142-d37edad4a78c tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:12.954328 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-072a2a73-eb69-4360-b142-d37edad4a78c tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:13.096826 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-072a2a73-eb69-4360-b142-d37edad4a78c tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:13.105838 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-072a2a73-eb69-4360-b142-d37edad4a78c tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1518 microversion: 2.1 time: 0.164503 May 23 12:58:13.106421 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 500/984] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:12 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:14.123060 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-ad685e43-2611-4fa6-acda-475827f21a71 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:14.123809 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-ad685e43-2611-4fa6-acda-475827f21a71 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:14.130601 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad685e43-2611-4fa6-acda-475827f21a71 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:14.131044 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad685e43-2611-4fa6-acda-475827f21a71 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:14.131808 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad685e43-2611-4fa6-acda-475827f21a71 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:14.132233 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-ad685e43-2611-4fa6-acda-475827f21a71 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:14.270185 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-ad685e43-2611-4fa6-acda-475827f21a71 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:14.278431 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-ad685e43-2611-4fa6-acda-475827f21a71 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1520 microversion: 2.1 time: 0.159359 May 23 12:58:14.279014 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 485/985] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:14 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:14.957344 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-a66df407-2a15-442d-ab5e-d825882ada75 req-c4a022d4-49fe-4524-81d8-645d2963eb72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff8f49d-1e9e-4ed2-891c-c88d71d981d3", "name": "network-vif-unplugged", "status": "completed", "tag": "579aef13-40d4-479a-8fd1-2eda9210e83a"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:58:14.967816 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-a66df407-2a15-442d-ab5e-d825882ada75 req-c4a022d4-49fe-4524-81d8-645d2963eb72 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:14.968505 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-a66df407-2a15-442d-ab5e-d825882ada75 req-c4a022d4-49fe-4524-81d8-645d2963eb72 service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:14.985714 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-a66df407-2a15-442d-ab5e-d825882ada75 req-c4a022d4-49fe-4524-81d8-645d2963eb72 service nova] Creating event network-vif-unplugged:579aef13-40d4-479a-8fd1-2eda9210e83a for instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 on hv-cinder-maste May 23 12:58:14.991285 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-a66df407-2a15-442d-ab5e-d825882ada75 req-c4a022d4-49fe-4524-81d8-645d2963eb72 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038428 May 23 12:58:14.992072 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 501/986] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:58:15.296279 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-e811c423-7656-468f-882c-6e2eec182cb0 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:15.296881 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-e811c423-7656-468f-882c-6e2eec182cb0 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:15.303340 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e811c423-7656-468f-882c-6e2eec182cb0 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:15.303783 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e811c423-7656-468f-882c-6e2eec182cb0 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:15.304536 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e811c423-7656-468f-882c-6e2eec182cb0 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:15.304962 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-e811c423-7656-468f-882c-6e2eec182cb0 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:15.434580 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-e811c423-7656-468f-882c-6e2eec182cb0 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:15.441988 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-e811c423-7656-468f-882c-6e2eec182cb0 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1576 microversion: 2.1 time: 0.149607 May 23 12:58:15.442541 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 486/987] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:15 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:16.460609 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-df6d64c7-7a88-4b45-ba94-10d33fee100e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:16.461351 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-df6d64c7-7a88-4b45-ba94-10d33fee100e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:16.467749 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-df6d64c7-7a88-4b45-ba94-10d33fee100e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:16.468192 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-df6d64c7-7a88-4b45-ba94-10d33fee100e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:16.468959 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-df6d64c7-7a88-4b45-ba94-10d33fee100e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:16.469419 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-df6d64c7-7a88-4b45-ba94-10d33fee100e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:16.600242 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-df6d64c7-7a88-4b45-ba94-10d33fee100e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:16.608218 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-df6d64c7-7a88-4b45-ba94-10d33fee100e tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1576 microversion: 2.1 time: 0.152731 May 23 12:58:16.608792 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 502/988] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:16 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 12:58:17.625266 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-a7127612-c2b1-4867-bf98-b99bcdf98f20 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:58:17.625814 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-a7127612-c2b1-4867-bf98-b99bcdf98f20 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:58:17.632261 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7127612-c2b1-4867-bf98-b99bcdf98f20 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:17.632707 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7127612-c2b1-4867-bf98-b99bcdf98f20 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:17.633497 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7127612-c2b1-4867-bf98-b99bcdf98f20 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:17.634272 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-a7127612-c2b1-4867-bf98-b99bcdf98f20 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:17.763137 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-a7127612-c2b1-4867-bf98-b99bcdf98f20 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:58:17.770581 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-a7127612-c2b1-4867-bf98-b99bcdf98f20 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1563 microversion: 2.1 time: 0.149278 May 23 12:58:17.771153 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 487/989] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:58:17 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:58:18.999424 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-349ed20c-83fa-4af6-8828-fbd8af24d544 req-8ada2770-bc01-4f6c-9c3d-4aa18d9e702f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff8f49d-1e9e-4ed2-891c-c88d71d981d3", "name": "network-vif-plugged", "status": "completed", "tag": "579aef13-40d4-479a-8fd1-2eda9210e83a"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:58:19.008150 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-349ed20c-83fa-4af6-8828-fbd8af24d544 req-8ada2770-bc01-4f6c-9c3d-4aa18d9e702f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:58:19.008593 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-349ed20c-83fa-4af6-8828-fbd8af24d544 req-8ada2770-bc01-4f6c-9c3d-4aa18d9e702f service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:58:19.020395 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-349ed20c-83fa-4af6-8828-fbd8af24d544 req-8ada2770-bc01-4f6c-9c3d-4aa18d9e702f service nova] Creating event network-vif-plugged:579aef13-40d4-479a-8fd1-2eda9210e83a for instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 on hv-cinder-maste May 23 12:58:19.026008 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-349ed20c-83fa-4af6-8828-fbd8af24d544 req-8ada2770-bc01-4f6c-9c3d-4aa18d9e702f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029605 May 23 12:58:19.026778 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 503/990] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:59:31.531449 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_api:SELECT=22 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:59:31.532189 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG dbcounter [-] [134547] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:59:31.535954 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_api:SELECT=22 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:59:31.536396 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-413a73ba-c0a8-49d7-bfb7-de4c27cb4bab tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:59:31.536892 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-413a73ba-c0a8-49d7-bfb7-de4c27cb4bab tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:59:31.537175 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG dbcounter [-] [134546] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:59:31.545208 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-413a73ba-c0a8-49d7-bfb7-de4c27cb4bab tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:59:31.546679 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-413a73ba-c0a8-49d7-bfb7-de4c27cb4bab tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:59:31.547697 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-413a73ba-c0a8-49d7-bfb7-de4c27cb4bab tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:59:31.548214 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-413a73ba-c0a8-49d7-bfb7-de4c27cb4bab tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:59:31.575284 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-413a73ba-c0a8-49d7-bfb7-de4c27cb4bab tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Going to try to terminate instance {{(pid=134547) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 12:59:31.639154 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-413a73ba-c0a8-49d7-bfb7-de4c27cb4bab tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [53b9c4df-3e88-4b54-b0c6-5fc6061b61c7] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 12:59:31.663072 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-db881455-1a8d-4de3-bea4-053dfb841e3b req-d5958da9-4005-4104-bd33-c5876fc681fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff8f49d-1e9e-4ed2-891c-c88d71d981d3", "tag": "579aef13-40d4-479a-8fd1-2eda9210e83a"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:59:31.672122 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-db881455-1a8d-4de3-bea4-053dfb841e3b req-d5958da9-4005-4104-bd33-c5876fc681fc service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:59:31.672638 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-db881455-1a8d-4de3-bea4-053dfb841e3b req-d5958da9-4005-4104-bd33-c5876fc681fc service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:59:31.685449 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-db881455-1a8d-4de3-bea4-053dfb841e3b req-d5958da9-4005-4104-bd33-c5876fc681fc service nova] Creating event network-changed:579aef13-40d4-479a-8fd1-2eda9210e83a for instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 on hv-cinder-maste May 23 12:59:31.690484 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-db881455-1a8d-4de3-bea4-053dfb841e3b req-d5958da9-4005-4104-bd33-c5876fc681fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157170 May 23 12:59:31.691398 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 504/991] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:59:32.647373 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO oslo.messaging._drivers.impl_rabbit [None req-413a73ba-c0a8-49d7-bfb7-de4c27cb4bab tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [53b9c4df-3e88-4b54-b0c6-5fc6061b61c7] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 46264. May 23 12:59:32.667919 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-413a73ba-c0a8-49d7-bfb7-de4c27cb4bab tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 204 len: 0 microversion: 2.1 time: 1.137645 May 23 12:59:32.668832 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 488/992] 10.222.0.45 () {58 vars in 1238 bytes} [Mon May 23 12:59:31 2022] DELETE /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 0 bytes in 1140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 12:59:32.679699 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-74f97984-efa8-4c7e-8d35-1af24c61ee23 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:59:32.680754 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.compute.api [None req-74f97984-efa8-4c7e-8d35-1af24c61ee23 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134546) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:59:32.688361 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-74f97984-efa8-4c7e-8d35-1af24c61ee23 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:59:32.688805 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-74f97984-efa8-4c7e-8d35-1af24c61ee23 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:59:32.689594 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-74f97984-efa8-4c7e-8d35-1af24c61ee23 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:59:32.690027 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [None req-74f97984-efa8-4c7e-8d35-1af24c61ee23 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:59:32.825336 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.policy [None req-74f97984-efa8-4c7e-8d35-1af24c61ee23 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134546) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:59:32.832751 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-74f97984-efa8-4c7e-8d35-1af24c61ee23 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1450 microversion: 2.1 time: 0.159305 May 23 12:59:32.833357 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 505/993] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:59:32 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:59:33.851274 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-43b3c637-9665-4b3f-8a32-7c50538fc874 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:59:33.851967 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-43b3c637-9665-4b3f-8a32-7c50538fc874 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:59:33.859321 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-43b3c637-9665-4b3f-8a32-7c50538fc874 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:59:33.859758 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-43b3c637-9665-4b3f-8a32-7c50538fc874 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:59:33.860630 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-43b3c637-9665-4b3f-8a32-7c50538fc874 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:59:33.861060 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-43b3c637-9665-4b3f-8a32-7c50538fc874 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:59:34.052240 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.policy [None req-43b3c637-9665-4b3f-8a32-7c50538fc874 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5623694b884f8f94c38d40812563c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94433bdea4e24d44a468370a418f79ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134547) authorize /opt/stack/nova/nova/policy.py:199}} May 23 12:59:34.060440 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-43b3c637-9665-4b3f-8a32-7c50538fc874 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 200 len: 1450 microversion: 2.1 time: 0.213352 May 23 12:59:34.061013 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 489/994] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:59:33 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 1450 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 12:59:34.511981 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [req-a841eda8-7584-4ab7-aa1c-2c9ae455f36c req-90c0210d-dd6c-41e0-9659-1a75aea1d02d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff8f49d-1e9e-4ed2-891c-c88d71d981d3", "name": "network-vif-deleted", "tag": "579aef13-40d4-479a-8fd1-2eda9210e83a"}]} {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 12:59:34.520089 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-a841eda8-7584-4ab7-aa1c-2c9ae455f36c req-90c0210d-dd6c-41e0-9659-1a75aea1d02d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:59:34.520580 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG oslo_concurrency.lockutils [req-a841eda8-7584-4ab7-aa1c-2c9ae455f36c req-90c0210d-dd6c-41e0-9659-1a75aea1d02d service nova] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:59:34.533015 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.compute.server_external_events [req-a841eda8-7584-4ab7-aa1c-2c9ae455f36c req-90c0210d-dd6c-41e0-9659-1a75aea1d02d service nova] Creating event network-vif-deleted:579aef13-40d4-479a-8fd1-2eda9210e83a for instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 on hv-cinder-maste May 23 12:59:34.537701 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [req-a841eda8-7584-4ab7-aa1c-2c9ae455f36c req-90c0210d-dd6c-41e0-9659-1a75aea1d02d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099373 May 23 12:59:34.538469 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 506/995] 10.222.0.45 () {64 vars in 1317 bytes} [Mon May 23 12:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 12:59:35.076907 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d199251a-fdff-4b08-82b0-d4c70032b4b1 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '>' {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:59:35.077600 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.compute.api [None req-d199251a-fdff-4b08-82b0-d4c70032b4b1 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] [instance: fff8f49d-1e9e-4ed2-891c-c88d71d981d3] Fetching instance by UUID {{(pid=134547) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 12:59:35.084055 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d199251a-fdff-4b08-82b0-d4c70032b4b1 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:59:35.084755 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d199251a-fdff-4b08-82b0-d4c70032b4b1 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:59:35.085560 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d199251a-fdff-4b08-82b0-d4c70032b4b1 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 12:59:35.085995 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG oslo_concurrency.lockutils [None req-d199251a-fdff-4b08-82b0-d4c70032b4b1 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Lock "42607727-9048-45c2-8317-fc63a315fdc3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 12:59:35.099423 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.wsgi [None req-d199251a-fdff-4b08-82b0-d4c70032b4b1 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] HTTP exception thrown: Instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 could not be found. May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d199251a-fdff-4b08-82b0-d4c70032b4b1 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Request method failure captured: May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: request: GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 HTTP/1.1 May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept: application/json May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: Accept-Encoding: identity May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: Connection: close May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Length: 0 May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: Content-Type: application/json May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: Host: 10.222.0.45 May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: Openstack-System-Scope: None May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: User-Agent: python-urllib3/1.26.9 May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Auth-Token: gAAAAABii4Q7pR6fxiRJG010hMspixNyzGfT-8BKF80OeVMAtHre-p4EJeOabcl2Phq1Ttvd_pXfqOXgg95qJfuDNsS7TLIRfuwwXeCikoOvpqM36I9zrJH8EG-tNSMJ6GDUwU2OAVXpNZjIlMS6fO584i76bamN6gm_9eluL74nvj30JtH9b5g May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Id: None May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Domain-Name: None May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Identity-Status: Confirmed May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Is-Admin-Project: True May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Id: default May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Domain-Name: Default May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Id: 94433bdea4e24d44a468370a418f79ad May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Project-Name: tempest-TestShelveInstance-246936944 May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Role: reader,member May 23 12:59:35.101058 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Roles: reader,member May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94433bdea4e24d44a468370a418f79ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/94433bdea4e24d44a468370a418f79ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/94433bdea4e24d44a468370a418f79ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_94433bdea4e24d44a468370a418f79ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}] May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant: tempest-TestShelveInstance-246936944 May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Id: 94433bdea4e24d44a468370a418f79ad May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-Tenant-Name: tempest-TestShelveInstance-246936944 May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User: tempest-TestShelveInstance-246936944-project May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Id: default May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Domain-Name: Default May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Id: 3e5623694b884f8f94c38d40812563c7 May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: X-User-Name: tempest-TestShelveInstance-246936944-project May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: method: > May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: exception: Instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 could not be found. May 23 12:59:35.102831 dv-cinder-master-3-smb devstack@n-api.service[134547]: action_args: {'id': 'fff8f49d-1e9e-4ed2-891c-c88d71d981d3'} May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: {{(pid=134547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 could not be found. May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 12:59:35.103815 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 could not be found. May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 could not be found. May 23 12:59:35.105944 dv-cinder-master-3-smb devstack@n-api.service[134547]: ERROR nova.api.openstack.wsgi May 23 12:59:35.107448 dv-cinder-master-3-smb devstack@n-api.service[134547]: DEBUG nova.api.openstack.wsgi [None req-d199251a-fdff-4b08-82b0-d4c70032b4b1 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Returning 404 to user: Instance fff8f49d-1e9e-4ed2-891c-c88d71d981d3 could not be found. {{(pid=134547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 12:59:35.107448 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO nova.api.openstack.requestlog [None req-d199251a-fdff-4b08-82b0-d4c70032b4b1 tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3" status: 404 len: 111 microversion: 2.1 time: 0.029669 May 23 12:59:35.107448 dv-cinder-master-3-smb devstack@n-api.service[134547]: [pid: 134547|app: 0|req: 490/996] 10.222.0.45 () {58 vars in 1235 bytes} [Mon May 23 12:59:35 2022] GET /compute/v2.1/servers/fff8f49d-1e9e-4ed2-891c-c88d71d981d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 12:59:35.261502 dv-cinder-master-3-smb devstack@n-api.service[134546]: DEBUG nova.api.openstack.wsgi [None req-87b5a06e-94b7-49a0-bdb3-18618bacebbe tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] Calling method '.version_select at 0x7f6a36be03a0>' {{(pid=134546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 12:59:35.279304 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO nova.api.openstack.requestlog [None req-87b5a06e-94b7-49a0-bdb3-18618bacebbe tempest-TestShelveInstance-246936944 tempest-TestShelveInstance-246936944-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-290085865" status: 202 len: 0 microversion: 2.1 time: 0.022102 May 23 12:59:35.279886 dv-cinder-master-3-smb devstack@n-api.service[134546]: [pid: 134546|app: 0|req: 507/997] 10.222.0.45 () {58 vars in 1250 bytes} [Mon May 23 12:59:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-290085865 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 12:59:47.757425 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 12:59:47.758118 dv-cinder-master-3-smb devstack@n-api.service[134546]: Mon May 23 12:59:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:01:02.592469 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:01:02.593079 dv-cinder-master-3-smb devstack@n-api.service[134547]: Mon May 23 13:01:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:02:30.855064 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:02:30.855809 dv-cinder-master-3-smb devstack@n-api.service[134547]: Mon May 23 13:02:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:02:53.454580 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:02:53.455113 dv-cinder-master-3-smb devstack@n-api.service[134546]: Mon May 23 13:02:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:03:07.766002 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:03:07.766631 dv-cinder-master-3-smb devstack@n-api.service[134546]: Mon May 23 13:03:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:04:22.600742 dv-cinder-master-3-smb devstack@n-api.service[134547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:04:22.601356 dv-cinder-master-3-smb devstack@n-api.service[134547]: Mon May 23 13:04:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 13:04:39.003187 dv-cinder-master-3-smb devstack@n-api.service[134546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 13:04:39.003753 dv-cinder-master-3-smb devstack@n-api.service[134546]: Mon May 23 13:04:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!